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Wliat contributions can current research in cognitive psychology make to the ^ 
sokition of problems in instructional design? This vohmie presents responses to 
this question from soipe of the best workers in an emerging field that I have 
hibeled "Cognilioit and Instruction'': people concerned with the investigation of 
the cognitive processes involved in instructional situations. The focus of this 
volume was presaged by comments made in a previous volume on cognitive 
psychology (Forehand, 1^)74): 

In what seems rcinaikably few years, infornution-processiiig psyeliology has come to 
dominate the experimental study of complex human behavior. That rapid success 
encourages ine to speculate that within a comparably short time the approach will have 
as much of an impact on psychology in the field as it has had on psychology in the 
laboratory. In particular, its potential for Uluminating recalcitrant problems in education 
seems evident [p. 159] . 

The chapters in this volume indicate the extent to which this potential has 
alre-ady begun to be reali/.ed. 

The book is divided into four parts. The first three parts include sets of re- 
search contributions followed by discussions, and the fourth part contains 
three chapters that offer critiques, syntheses, and evaluations of various aspects 
of the preceeding papers. 

The^^chapters in Part 1 represent different strategies for instructional research. 
In the first chapter, Carroll, raising some of the issues facing psycholinguistic 
theory, asks whether we yet know enough to intentionally teach language 
skUls according to' a systematic instructional theory. He summarizes three 
lines of theoretical development--naive, behavioral, and cognitive-that bear 
upon the issue, and finally suggests that an information-processing view of 
the cognitive processes underlying language behavior may ultimately provide the 
basis for a theory of language instruction. In Chapter 2, Calfee presents a 
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research stuitegy that hocuses upon the iiiterprelatiDii of the empirical rcsuUs 
obtained in both the laboratory- and in instructional settings. He points out 
the potential pitfalls awaiting the instructional evaluattir who has not care- 
fully considered ah possible sources of interdependency in the cognitive models. 
The statistical analyses proposed by Calfee may be useful to those faced with the 
task of identifying the extent and the pattern oi' the effects of mstruction. 

Resnick focuses upon the area of early nuitlie*natics instruction, and she 
reviews and evaluares the precursors of current proL^^dures in task analysis. Her 
contiibution traces the development of a strategy inninstructional research that 
utilizes information-processuiu nunleis o( cognition to meet the practical 
demands of creating effective instriictiiMial procedures. \ 

Atkinson [irin'ides a glimpse of the latest products of Ins extensive research 
prtv^ranu which is ainieil at developing what he calls '^adaptive instructional 
systems.'^ His research strategy is based upon' the view that ^^an all-inclusive 
theory of learniim is not a prerequisite for the development of optimal 
jirocedures.'' 

Will I conclUiies with discussions by Cireug and ()lst)n, ami their connnents 
hirther emphasise the vaiietv o\' strategic apfiroaclies to research on instruction, 
(iregg argues l\)r the ini[U)rtance ot understanding and representing the learner's 
strategies in instructitinal situations, whereas Olson raises' the issue of the 
ultimate social utility of what we decide to teach to chiklren. 

I he chapters in Part 11 focus upon process and structure in learning. The 
emphasis is upon the precise, explicit, and detailed representation of what is 
learned, how it is utilized, ami how it is modified. In Chapter 7, Greeno" 
demonstrates what such an extensive repiesentation might look like. He provides 
an elaborate statement of the cognitive iihjectives for three different areas: 
elementar\ aiitlinietic, high-school geometry, and college-level psychophysics. 
Knowledge in each area is representeil by a different collection of building 
blocks taken froni current inlormation-processiiig theories. 

One ol the central issues in instructional research is Imw new knowledge is 
acqnnecL livman. in ('!ia]iter S. describes a paradigm lor exploring the wa\'s in 
which memotv is restructured when new initirnuition is discrepnnt from pre- 
existent sterentvpes. llymaii uses a [Kiiadiizin borroweil from social psychological 
studies ol imf)re-ssion formation, and slu>ws that it havimplieations for the more 
la'Ueral issue of information acquisition. 

In Chaptei ^\ Norman, (ieiitner, and Stevens utili/e tools some of them 
ahead>' tlescnbed by Cjreeiuv lo deiine the general notion of "schema." The 
analysis in NiMinaiu (]eiiliier, and Stevens is extrelnely fine grained; they 
develop detailed representations for an increasingly .rich understanding t)f such 
basic concepts as '^jjve'' and "buv/^ They anuie that such representations make 
it possible to~he quite precise about iu)w instruction should proceed. 

Shaw, anti Wilson, m Cliapter 10, address the issues of process and structure 
Uom a more abstract almost i^hilosoplucal posili(Mi, but ti?ey also provide 
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concrete exaiuplcii from Shaw's work on perception. Thi2 central issues concern 
the ability to understand an entire concept from experience with just a sMibset of 
its Instances. Such an abillt\ . Shaw and Wilson aigue, lies at the heart of an 
understanding of invariance. 

The discussitms by ['arnham-Dig^iory (Thapter 1 1 ) aiul by 1 layes (Chapter 12) 
offer ^stimulating critiques of the positions presented Jn Part 11. Citing an 
alarmingly modern instructional program devised cnvr half a century ago. Farn- 
hani-Diggory asks tlrst ''What's [lew?" and then "Is it better?'^ Ihiyes suggests 
some ways that one can begni to tri:'j[i students directly in cognitive skills, lie 
focuses- upon a recurring theme in the chapters of Part If: "What does the 
student know about -his own cognitive /processes?" 

An essential but neglected element in instructional research is the role of 
instructions per se. and tlie contribi/nions to Part 111 focus upon the processes 
that luulerlie the comprehension of yerbal instructions. Just and Carpenter take 
the sentence as theu unit of analysis/, I'sing a sopliisticati^d and Explicit model of 
sentence [irocessing. the\ are able io account for mi impressive variety of 
empirical results. "I hen they suggest ways in which /arger units, such as those 
used in reading comprehension tests, could be analy/eu similarly. Simon and 
Hayes take a larger unit ot analy:iis the entue mstruction set. They report on 
the development of an inforniatifon-processing nuidel aimed at explaining the 
processes that underly the unde/standing of instructions for complex pu/zles. 
Then, using the unandiiguiuis cojiiponents of their model as points of reference, 
they sketch the broader implications that a theory of understanding could have 
for instructional research and prtictice. 

In the discussions in Part III, Collins (Chapter 15) and .Shaw (Chapter Ur) 
suggest areas for extension of the models of comprehension described earlier. 
Collins asks alioiit the nature' of the comparison process a basic unitary process 
in the Just and Carpenter model and speculates that it might itself be composed 
of even more elementary sn/iprocesses. Another issue raised b\ Collins is the role 
played b\ the broader kiunv ledge base in which the comprehension processes for 
sentences or task instructions operate. 

Shaw's comments range s()inewliat farther afiekK toiiching on the papers in 
Part II as well as tlu^se in PaM lII. He outlines programs in two diverse areas- art 
instruction and iieatmeni of aphasia that derive from a theory of compie- 
hension tliat draws upon elements of the models presented in many of the 
previous cliapteis. 

The three chapters in the lourtli and final section represent responses to many 
of the issues raised in pievious chapters. (Jlaser (Chapter 17) addresses the issue 
of how we can take the results of scientific research and apply tlieiii to practical 
proldems. He argues' foi the development oi' a linking science- a science of 
instructional design tlijlit would transform oui knowledge of cognitive processes 
into instructional jnocedures while at the same time providing tests and clial- 
t> • lenges for the existing theories. (*a/den (Chapter 18) raises some very practical 
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questions based upon her varied experience as bath a classroom teacher and a 
research psychologist. One example of the kind of issue that is central to a" 
theory* of instruction but still inadequately handled by our current theories is 
Ca/den's question: ''Wliat is the value of practice?'' Finally, Klahr (Chapter 19) 
sketches some of the issues that would need to be resolved before one could 
construct a model of a learner. . 



ACKNOWLEDGMENTS 

The contributions to this volunie are based on some of the presentations given at 
the Tenth Annual Carnegie Symposium on Cognition, during the- first week in 
June. r^^74, \n Vail, Colorado. The Symposium was supported by a contract 
jointly fundeil by the Personnel and Training Research Programs, Division of 
Psychological Sciences of the Office of Naval Research, and^" the Advanced 
Research Projects Agency of the Department of Lcfense. It was held under the 
auspices of the Department of Psychology at Carnegie-Mellon University. 

Several people who do not huve chapters in this volume nevertheless have had 
an inlluence on its contents. These people presented workshops at the Sympo- 
sium: inf',/inial descriptions of on-going instructional explorations. The work- 
shops were distributed throilgh the week of the Symposium in order to provide 
some concrete instances of interesting instructional problems. The workshop 
leaders were not requested to prepare fonnal papers: thus, the workshops arc not 
-included in this volume.. There seemed to be no adequate way to convey the 
content of the w(ukshops and the^^discussioii they generated, although much of 
the intellectual excitement during the Symposium came from these sources. 
The workshops' included: 

1. ''The adaptation of instructiiMi to individual differences: an Information- 
processing approach.'' by J,Ci, Wallace, University of Southampton. 

2. "On some cognitive processes presumed to be operating in computer 
assisted instruction.'' by Dexter rietcher. University of Illinois. 

3. 'Mntuiiive and formal modes of representing music," by Jean Bamberger, 
Massachusetts Institute of Technology. 

4. "Teaching probleni solving," by J. R. Hayes. Carnegie-Mellon University. 

5. Teaching formal operations." by Robert Siegler, Carnegie-Mellon Univer- 
sity, . ' 

I would like to thank each of these participants for enriching the Symposium 
with their nilormal presentations. 

In organizing the Tenth Symposium and in editing this volume, ! was assisted 
in diverse ways by several.of my colleagues at CMU. Careful and critical readings 
of earlv drafts (»f various chapters were ablv done by John S. Carroll, J. R. 

ERLC 8 / 



PREFACE xm 



Hayes,"William Leaf, 'c\nd especially Jola A. Jakirriik. Bibliographic assistance 
came from Elaine Shelton, and Marlene Naugliton did the lioness* share of the 
secretarial work for botiv the Symposium and the book itself. Symposium 
planning, execution, and follow-up were i^j^isterfuily managed by Marcia Gold- 
stein, assisted by Marshall Atlas, Michelene Chi, and Kenneth Kotovsky. I would 
like to thank all of these people for assisting a neophyte editor and symposium 
organizer, l' would also like to acknowledge the constructive approach to 
contract supervision that was evidenced by Dr. ' Joseph L. Young, Assistant 
Director of the Personnel and Training Research Programs, Office of Naval 
Research. He played a key role in the initial conception of the Symposium topic 
and provided unobtrusive encouragement throughout the^'whole enterprise. 
• Finally, I gladly , thank my wife Pat for her advice, encouragement, and 
wisdom, and for the assumption of responsibilities that this book at times caused 
me to neglect. 

DAVID KLAHR 
Pittsburgh, Pennsylvania 



c 

V • 

COGNITION AND INSTRUCTION 

# ■ ... 



ERIC 



10 

0 



Part I 



STRATEGIES FOR 
INSTRUCTIONAL RESEARCH 



It is often tliouglit and said that what we 
most need in education is wisdom and broad 
understanding of the i^'^ues that confront us. 
Not at all, I say. \Vliat we need are deeply 
structured theories in education that drasti- 
ccally reduce, if not eliminate, the need fo1- 
wisdom, i do not want wise men to design 
or build the drplane 1 fly in, but rather 
technical men who understand the theory of 
aerodynamics and the structural properties 
of metal ... And so ^ is with educa- 
tion ... I want to see a new generation of 
trained theorists and an equally competent 
band of experimentalists to surround them, 
and I look for a day when they will show 
that the theories I now cherish were merely 
humble way stations on the road to the 
theoretical palaces they have constructed 
(Suppes. 19741: 
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Promoting Language Skills; 
The Role of Instruction 



John B, Carroll 
Educational Testing Serviee^ 



Can language skills be tauglit? The answer to this question depends upon how we 
define "language skjlls" and what we mean by '^^teaching." There appears to be a 
fundafnental divergence-usualiy between behavioral, scientists *on the one hand 
and educators on the other— as to what these 'terms mean. 

In the context of behavioral science, instruction is often taken to mean 
definite, specifiable "behavioral" objectives, liighly-controlled instructional set- 
tings and materials, and definite procedures for observing and measuring learning 
. outcomes. But in the minds of educators, it is generally the case that: 

^Instruction' is a word within Uie system (education) tliat has no operational defini- 
tion. It refers to many different ways in which the relationships among students, 
'teachers, learning materials may be structured. .Discursive situations, at all levels of 
instruction, tend to be seen as effective. They, and other types of structured situations, 
are being defended against displacement by instruction geared only t<3 operationalhed 
episodes (Dickinson, 1971, p. 112). . - 

Eveh^McKeachie (1974), a behavioral scientist, is inclined to express his unhappi- 
ness with the terrn ''instructional .psychology," ^"for 'instruction,' carries a 
connotation of teacher direction or building that is less pleasing/, . than the 
emphasis on the student implied in 'learning' [p. 162] c 

Dispute over the meaning of 'instruction" and "teaching" is fpund also among 
educational pliilosophers. It is commonly agreed that teaching is any activity 
that is designed to 'result in learning on the part of the individual being taught, 
but there is'debate as to whether such an activity should be called teacliing when 
there is no intent on the part of the teacher to teach, or ^yh3n it is not successful 
: in producing its intended outcome (Scheffler, 1960). 

o 

^ Currently, Department of Psychology, University of North Carolina at Chapel Hill. \ 
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• Consider the claim that the child learns his native language without being 
"taught;^ simply by "exposure'' to adult models. To support such a claim, one 
would have, to have in mind how he distinguishes between teaching and non- 
toaching. and how he means to detuie "exposure," On the other hand, it is 
ct>m.monly accepted that one can 'Ueach'^ vocabulary knowledge, or a foreign 
language. 

If we are to study rationally the problems of teaching huiguage skills, we must 
embrace such concepts 'as '^creativity in language" within a scientific, deter- 
ministic framework. If there is such a thing as a natively predetermined "lan- 
guage acquisition device" (McNeill, 1^)70) that accounts for the acquisition of 
language skills, we must describe it scientifically. If the system of language is 
"internalized'' by language learners, the resultant internalized states must be 
open to scien title study by appropriate observation of the "behavior" (broadly 
iK^tlned) that occurs under specifiable conditions. Some of these '^specifiable 
conditions" will fall under the concept of "instruction," but I assume that they 
will cover ni>t only the kinds of deliberate, formal operations that a teacher 
pertorms in the classr()i)m, but also the informal, largely nonJelibciaLC actions of 
people interacting with each other through language and other . means, for 
example, the interactions i)f a mother ;uul her child, or the ipteractions of one 
student with another in a "discursive" situation, Wliether these actions are taken 
with an "intent" to teach or produce learning, and whether these actions are 
"successtul" in producing learning, are questions that are not of central interest. 
It does not much matter whether or not wo say diat tlu. child learns his language 
"without being taught." What matters is what external influences, that we might 
be able to have under t ur option or control, there are upon the child's learning. 
There are many .kinds of "language skills"; speaking, listening, .reading,'hand- 
writing, spelling, and wntten composition are the native-language skills that are 
given most attention ih the schools, but we miglU also want to discuss what are 
otton. called "communication skills," including nonverbal communication skills. 
In all these skills, there is a developmental dimension as the individual moves 
Irnrn infancy to adulthood. In a previous publication (rarroll, U)71b) fhave 
reviewed the literature the development 'of these native-language skills be- 
yond the early years. In addition, we may want to consider the problems pf 
teaching a second or a tbreign language, or of teaching a ''standard" form of a 
language when the learner's native tongue is a "nonstandard" form of that 
language, I have reviewed research on nu'!;y aspects of these matters in a number 
of publications ((\irroll, • I 1%6, l')68a, l^)71a), and I do not intend to 
recapitulate these reviews here. Instead, I propose to ibcu,s attention on the 
mtnlvh of the kmmm' learner that seem to be implicitly assumed by teachers, 
vvitcrs of instructional materials, ami others in education, as well as such models 
as are i)ftered by psychologists, psycholinguists, and' linguists. We nuist see in 
what respects these models are inadequate or conflict with one another. We nuist 
also attend to what role these models assume tor "instruction" defined broadly 
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as any external influences on the development of language skills, as represented 
both by tbrnial teaching actions and by more informal social interactions. 

NOTIONS OF SKILL, COMPETENCE, AND PERFORMANCE 

If we are to begin promoting language skills, we need a notion of what these 
skills consist of. Indeed, it would be to our advantage if we had available a 
complete theory of how people acquire and use language skills-both productive 
and receptive skills, and both skills with the spoken language and skills with the 
written forms of language. 

One prerequisite for the development of .such a theory is consideration of the 
relation between a language system, as described by linguists, and the activities 
and behaviors that involve its use. In recent years, this problem has been 
discussed in terms of the distinction, most trenchantly formulated by-Chomsky 
(1965), between "competence" and "performance." The distinction has been 
debated, almost ad nauseam (liever, 1070; Fillenbaum, 1971; Fodor & Garrett, 
1966; Hayes; 1970) and it would be a distraction to fully discuss tlie matter 
here, but since I have a particular viewpoint, f need to state my position with 
some semblc^nce of justification. I believe that all Chomsky literally meant to 
refer to was,. on the one hand, what is learned (competence), and on the other, 
the behavior that manifests that learning (performance), including both receptive 
and productive language behaviors. The notion of competence is entirely neutral 
as to what type of grammatical model should describe competence. Chomsky 
offered generative grammars as theories of competence, but linguists (and 
others) are free to select other kinds of grammar to describe competence. 
Further, the notion of performance is neutral as to what theory or model of 
poriornvdncc mechanisms one might adopt; a model of performance mechanisms 
niiglit be derived from behavioristic principles, from cognitive psychology, or 
from any other psychological system. Much of the discussion about competence 
and performancii, hf)wever, has been concerned with the extent to which a 
model, of performance must "incorporate" a competence model, "and if so, 
whether the competence model (i.e., the type of grammar chosen) determines 
the form of tlie performance model. In my opinion the determination is in tlie 
opposite direction: Ihe form chosen for the performance model will tend to 
dictate the Torni of the '^competence mqdel and therefore the form of the 
grammar. This is the case because the mechanisms or processes that a perfor- 
mance model assumes are not indifferent to their content, i.e., to the elements 
upon which they operate. 

There are perhaps many possible ways to v/iit'v grammars for verbal ojitput, 
but the type of grammar that makes psychological sense is determined liy the 
. kinds of mechanisms that are assumed in the performance model. There are 
various alleged demonstrations (e.g., Bever, Fodor, & Garrett, 1968) that a 
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traiisfurmatiorial grammar cannot be handled by an associationistic, "stimulus- 
response" theory. This is usually interpreted to mean that a behavioristic 
account of lanuuaiie behavior is unacceptable so great is the taith in transforma- 
tional grammar. Suppose, however, that //c mechanism can be found to handle 
such a grammar. (In fact. I am not aware that anyune has formulated such a 
mechanism.) This would present a problem of the psychological acceptability of 
transfonnational grammar for any performance model. 

My conclusion is that the designer t)f a per formance model can niYord to be 
indiflererit concerning what type of grammatlLal theory the linguist may want to 
choose to satisfy his.ur her own criteria. As a psychologist, my criteria lie within 
the realm of psychology. Thu,s> the kind of grammar I choose must satisfy the 
basic psychological criterion that U must be plausible from the standpoint of 
being capable of being handled by known or discoverable psychological pro- 
cesses, in eitcct, this means that a grammar for a given language system must be 
included witlmi the performance model for that language; the distinction be- 
tween competence and performance remains as before- competence refers to 
what is learned, pertormance refers to a behavior tuanifesting that learning. 

This point of view is actually not as heretical as it may seem. Labov (1^)71, p. 
4^2) says: 'There seems to be general agreement that n valid theory of language 
must eventually be based on rules that speakers actually use.'' Bever (1070, p. 
345) tells his readers that if they will "accept the possibility that ongoing speech 
behavior does not utilize a linguistic grainmar/' they will not be surprised "that 
the mechanisms inherent to ongoing speech behavior do not nmnifest transfor- 
mations or any operations directly based on them.'' 

A point of view that seems much closer to mine is that of Schlesinger (1^71), 
who WTites!* ^ 

I hero IS no plu^v tor intontipris in a {'.raniniar, but any theory of |icrformancc which 
tails ti> take intentions into account must be considered inaCieqiiato. Ilic model of a 
human speaker must, of course, contain rnhs that determine, the iiratnmatical structure 
o{ thi' output. I hose rules, however, must be assumed to operate on an inp-it wliidv' 
represents tlie speaker's intentions (p 64 | . 

I Wi)uld idejitily these rides as a rgrammar incorporated into a performance 
graOTuar ir\VSehlesinger's terms, they would be '^realization rules" for convert- 
ing '1 "markers" {input or intention markers) into utterances. There is a certain 
snuilarity here to Bevcr's (1970. p. 286) notion that '^'iiiking involves actively 
mappmg iriterual sfructures onto external sequences, and understanding others 
involves mapping external sequences onto internal structures" that is, if we 
identify internal structures with Schlesinger's 1 markers. Much of Bever's paper is 
concerned with trying to identify 'Nieuristics" or "cognitive strategies" whereby 
the hearer frnds out how "external seipiences" (i.e., strings of speech) are to be 
mapped into internal structures. While it is'debatablc whether he has identified 
the heuristics that language users actually employ, the enterprise seems to be in 
the right dircctiiHi. 
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To emphasize the claim that the grammar must be incorporated in, and 
jdetermined by, the performance model, 1 have called the grammar that I have 
developed for a small subset of English sentences a ^'performance grammar" 
(Carroll, 1974a). This performance grammar thus far centers attention on 
language production: it is my belief that the problem of production must be 
dealt with before problems of reception and comprehension can properly be 
investigated. This is because the hearer's problem is to determine the I marker of 
the speaker; it seems reasonable to suppose that to the extent that speaker and 
hearer share the same language system, the hearer would rely to a large extent on 
the same "realization rules" for converting I markers into speech that the 
Speaker does. The perfonnance grammar is conceived of as having two compo- 
nents: the intentive component, and the code component. The intentive com- 
ponent specifies the elements, variables, and structures found in I markers, and 
the Cv)de component contains the "realization" rules for converting the contents 
of 1 markers into grammatically acceptable speech. The rules in the code 
component can be stated as "production-systems" in Newell's (1973) sense, i.e., 
tliey can be stated in the form of one or more condition-action pairs. This type 
of grammar, incidentally, is exemplified also by Halliday's systemic grammar 
(fludson, 1971; Muir, 1972), which Morton (1968) calls a "Category B" gram- 
mar that describes how language behavior can be produced outside the rules of 
grammars of a more linguistic character. Like my performance grammar, Halli- 
day's systemic grammar'emphasizes the choices open to the speaker as he speaks, 
but I would feel that the "intentive" component of Halliday's grammar is as yet 
only- a latent structure; i.e., the conditions for the choices are not made explicit, 
whereas they would have to be in a complete performance grammar. 

Discussions of "competence" in linguistics have laid little' emphasis on whether 
the competence may vary from one speaker to another, or whether competence 
can be quantified. Muscat-Tabakowska (196^) has presented an interesting 
discussion of these as issued they apply in foreign-language teaching; her remarks 
are applicable also to the competence of native speakers. She narrows the 
definition of competence to mean "the actual knowledge of the underlying 
system of rules at a given time/' from which she concludes that (1) "compe- 
tence . . . can be learned, and probably can also be taught; (2) competence is 
relative, for it can be bigger or smaller, both in different speakers at the same 
time and in the same ^eakers tit different times; and (3) competence is 
measurable, in that it is possible to infer the amount of competence fro,m the ob- 
servable data (from performance) . . . [Muscat-Tabakb'wska, 1969, pp. 42-43] ." 

Elsewhere (Carroll, 1968b) I have set forth a series of propositions about 
competence and performance in their application to problems of testing compe- 
tence in a foreign language, but they are equally applicable to similar problems 
in a speaker*s.native language. Among these are: 

Competence in a language consists of a series ot interrelated habits (acquired stimulus- - 
response meehanisms) which can be described in terms of stated 'rules' |p. 47] . 
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The actual manitestatn)n ol hiU'Uistic competence , . . in behavior may he called 
lin^juiNtic perU>muMce. and is aftected bv a lar^'.e ruinber of nonlincuistic variables fn. 
501. 

I further asserted that: 

I here arc individual dineroiice^. l)oth in competence and perl ormance variables, that 
may bo a tunction ul either consti*utional or experiential variables [p. 51 1. 

I pointed out that individual ditTerences in competonce might be found in 
different domains, such as phonology, morphology, lexicon, a-id grammar, and 
that individual differences in performance could he ohserved in such matters as 
speed of response, diversity of response, complexity of information processing, 
and awareness of competence. 

Such an analysis .of linguistic competences and performances suggests that it is 
quite possible that a diversity of detailed psychological models may need to be 
incorporated in a complete performance model. For example, the psychological 
model used to study the acquisition of a lexical item as a liftguistic form may be 
different from the one used to study the meaning of that linguistic form, and a 
still different model may be required to account for the acquisition of the J 
grammatical category and distributional characteristics of the form. Further, 
models for the acquisition of phonological item^, or of grarrmuitical rules, may be 
radically different from any of the models required in connection with: lexical 
forms. We may already be able to apply certain standard paradigms (Mdton, 
1^)64) to several of these casesi for example, acquisition of lexical meanings inay 
be a case of associationistic learning, or a case of concept learning: and acquisi- 
tion of phonological competence may have elements of perceptual learning and 
of psychomotor learning. Where our standard paradigms seem to fail most is in • 
explaining the acquisition of grammatical rules. It is'still unclear what the source • 
of the diftlculty may be: is it that appropriate psychokjgical models have not 
even been discovered, let-alone refined, or is it that we have not discovered the 
way in which grammatical rules should be formulated .so as to lend themselves to 
the application of psychological models*' 1 suspect there are difficulties on both 
of these counts. 



NAIVE, BEHAVIORISTIC, AND COGNITIVE THEORIES 
OF LANGUAGE LEARNING 

What happens when neople (or other organisms) acquire language skills? What 
models of the language learning process .seem to be assumed by their teachers, or 
by people who prepare instructional materials? 

That people do learn language, even when tauglit by teachers (e.g., mothers) 
uninformed about any systematic scientific principles of learning, is evident. 
Whether people learn any better when they are taugtu according to some 
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systematic theory of instruction is not so evident. Even if the teacher, or the 
preparer of instructional materials, can be assumed to have been influenced by 
some doctrine about learning and teaching, it is hard to tell, from an instance oftiis 
or her teaching, whether he or she is actually beingguidod by that doctrine, unless 
he or she explicitly tells us so. 

I will discuss three ''theories'' of language learning and teaching. I assum'e, 
first, tliat.a "naive" .or ''common sense'' theory of learning exists, that in fact it 
has existed for centuries; and that this ''naive" theory underlies the instructional 
procedures used by most people engaged in promoting language skills -whether 
they be mothers teaching their children to speak or formally certified teachers of 
English or foreign languages. I do not employ the term "naive" in a pejorative 
sense, but rather to refer to the kind of "common-sense psychology," described 
by Heider 119^^8, pp. 5-^7), as summarizing the common wisdom that people 
have about their behavior and motives. Of course, a naive theory of learning may 
in many respects be niaccurate, wrong, or wrongly applied. Nevertheless, it 
cannot, be all wrong, since it has been part of the underlying foundation of 
teaching and learning over the centuries, that is, the kind of teaching that has 
been at least partly successful. ^ 

Second, I will describe how "behavior theory" has singled out for 
aiialysis and reinterpretatiibi certain features of the naive theory. By ^'behavior 
theory," I mean one comparable to Skinner's (1^)53, 1957) with its emphasis on 
Operant conditioning. 

Third, I will indicate some limitations of Skinncrian behavior theory and point 
out how cognitive theor>- provides a refinement of naive theory (and a reinter- 
pretation of behavior theory). The discussion will then lead the implications 
of cognitive theory for instructional procedures in promoting language skills. 

Assumptions of Naive, Learning Theory 

If we exannne typical instructional materials, observe instructional episodes, or 
talk With teachers, we. can infer that naive learning tiieory is based on eight 
principal implicit assumptions: 

' /. Lcarnini^ inrurs hc<;t when it is "'motivated." Ideally, maximum learning 
occurs when the individual ''wants to learn." Helen Keller 119.V6. pp. 23^24) 
recalls that alter arriving at an understanding that "everything has a name" 
through being shown how the word water is finger spelled, she "left the well 
house eager to learn." Most textbooks are written on the assumption that they 
will be used by ''motivated" students: some, of them attempt, however, to 
stimulate motivation and interest. Naive theory further assumes that if an 
individual does not want to learn, he can nevertheless be made to learn by 
drawing his attention to the consequences of Jiot learning. The critical role of. 
motivation is assumed to be in every case to direct and focus the individual's 
attention on what is to be learned. 
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2. TIuis, a critical variable in learning is attention, i.e., a state of the learner 
wliereby he becomes consciously aware ot* the material to' be learned and 
examines it according to whatever means are necessary. Wlien the matter is 
complex, this may require diligent study, but even in simple cases, some degree 
of "'attention" is required. We have a report (McNeill, 1970, p. 106) of a mother 
trying to "correct" her child's tendency of saying ''Nobody don't like me." 
After a series of unsuccessful attempts, she says: ''Now listen carefully: say 
'nobody likes me.' In the child's response, "Oh! Nobody don't likes me," it is 
evident that the child does in fact pay greater attention to the stimulus than 
before, even though the response is not quite what the mother hoped for. A 
series of steps recommended by Fitzgerald (1951) for learning to spell a word 
include admonitions to "look at the word . . . pronounce it . . . see the 
word . . .say it . . . make every letter carefully/' In reporting how she learned 
the finger-spelling tor water Keller (1936) notes that "iier whole attention was 
llxed" on the motion. of her teacher's fingers. 

A corollary of this proposition is the principle "one thing at a time." It is 
assumed that to maximize attention, attention should be directed at only one 
thing at a time. Divided attention and distractions retard learning. Thus, if the 
thing-to-be-learned is complex, its parts must be attended to separately . Fitz- 
gerald (19.S1), in tlie prescriptions mentioned eariier, advises the student to "say 
the letters in order" and "make every letter carefully." Instructional materials 
g^^nerally attempt to focus the student's attention on particular aspects of what 
is to be learned. 

Another corollary is that the learner controls thejearning in that he can 
C{)ntrol his attention, and is generally aware of how much and how well he 
kn6ws he has learned at a given point (tlie student, of coUrse, be mistaken about, 
his state ofTcnowledge.). 

3. The result of learning, is some change in internal state. This can be either a 
change in state of knowledge about facts, rules, opinions, etc., (''knowledge 
that . . . "). or a change in state of knowledge aboiit procedures and behaviors 
("knowledge how to ../").. Knowledge can come from a number of 
sources experience, observations of place, events, and. others' behavior, lectures 
and explanation:,, or eveh from mental discovcry-"using one's head." Informa- 
tion may be stored a$ memories, although some memories can be forgotten. 
Memories about behaviors- are stored as "habi \" Knowledge can even include 
information about how to learn: Fitzgerald's prescripti^Ons about learning to 



spell are of this nature. These assumptions about what is to be learned are 
illustrated in a "bulletin" suggested for use in. a "bjStter speech'campaigri" for 
speakers (if nonstandard dialects at the secondary school level (Golden, 1960, p. 
94). Golden assumes that in order for the nonstandard speaker to learn to avoid 
usages like shouldn't ought, disremeniber, and irregardless, he or she first needs 
to be told that they- are "wastebasket" words, even though there is "nothing* 
really wrong" with their use in some situations. In his. text on teaching English as '■ 
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a second language, Dixson ( 1971> p. 2) gives rules for forining Ihe negative ofto 
he: *'We form the negative of to bo by placing not after the verb.'' A widely used 
textbook of Spanish (Bolinger et uL, I960, p. 57) teaches the student the 
distinction between Spanish scr and cstar by a lengthy discussit)n of the varying 
uses and meanings of these forms; that is, the student is assumed to need a store 
of information or knowledge about them in order to learn to use them according 
to Spanish norms. 

4. Practice and repetition contribute to the establishment and strengthening 
of memories. Memt)ries become clearer and firmer by repeated exposure to the 
subject to be learned. This is believed to be true both for memories of experi- 
ences and for memories of behaviors (i.e., habits). Retrieval of memories for 
experiences eventually becomes extremely facile after repeated exposure to the 
stimuli, and behavior repeatedly performed becomes extremely ''automatic" 
when the conditions for that behavior are appropriate. Fitzgerald's (1951) 
prescriptions for the learning of spelling advise the student to spell a word 
several times, each time checking its correctness. Golden (1960) advises stu- 
dents: 

''This shiiling and pcrtecting oi language pattern is not done easily or overnight. ... As 
it takes continuous -practii'i: and many otlicr factors to shift from being merely a 
chop-sticks player to hcinji a good musician, so it takes practice and tho\ight and desire 
and then more practice to shilt into using the pattern that is universal, and to feel so 
much at home in the new pattern that we can truly 'make music' with it [p. 94] . 

Bloomfield's ( 1942) final admonition to the foreign language learner is 'TRAC- 
TICE EVERYTHING UNTIL IT BECOMES SECOND NATURE [p. 16, capitali- 
/iition in the original] 

5. There are degrees of learning, and until perfect mastery is attained, re- 
* sponses must be checked for their ''correctness/\'"FeQdbvLck'' has thp primary 

• function of giving the learner information which he can use to compare his or 
her response with what the respohse should be: whether it "rewards" or punishes 
the learner is of secondary concern. We have already cited Fitzgerald's advice to 
the learner to check the correctness of his efforts to spell a word each time he 
tries it, ' ' 

6. Rewards are administered by external agencies for the act of learning (and 
punishments for failures in learning); one does not reward or punish the actual 
behavior performed, but the learner himself Rewards and punishments are seen 

^ as constituting information to the learner regarding the consequences of learning 
or not learning; this is true whether the rewards and punishments are adminis- 
tered verbally or physically. Rewards (school grades, ''A/' '*B.'' etc.) are also 
given to convey inforiTiation. to the learner coneerning his overall progress in 
learning. 

7. Learning builds on prior knowledge and habits. Teachers and textbook 
-authors generally mean to take account of knowledge and habits already ac- 
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quired at a given point, fl' we look at raiuioni at almost any page t)fa textbook, 
we can usually inter what the textbook writer assumes the student knows or has 
learned up io that point. 

S. Lcanmii^ is an active process, 'leannng by doing" is a watchword among 
many e^Ocatioiiai writers. Textbook authors are aware of the n.red to have 
studen^ be ^ible to make active, uncued responses, For'example, in the Spanish 
textbook cited earlier (Bolingern'/ aL, I960, p, 28), it is pointed out that the 
stud^ts^ bot)ks must be closed during the performance of a drill on person- 
nuiriher sub.stitutions. ^ 

The above assumptions apply m>)t only to language learning but in fact to most 
types of school learning, and to most other types of learning as well. The special 
diftlculties in applying these assumptions to certain aspects of language learning 
(e g., the cliild\ learning of his native language, particularly its grammar) are 
only dimly perceived in naive theory, but a special theory, that of "imitation," is • 
applied to explain language learning. Naive learning theory attaches importance 
to imitation as a learning process because behavior that is apparently imitative is 
frequently observed. Mothers try to get their children to imitate their language 
and are sometmies successful: Ktibashigawa (1968) reports an episode in which a 
mothvr elicits 'a ftirm by u.sing a question intoiuititin; .the child tends to imitate 
not only the form but the intonation, and imitates a different intoiuition when 
the mother changes hers: 

Mt»rlicr: I lur's ,i radio, , . . A railitV,^ fwith question intonation) 

C hild: jwe-ol f with question inlonatitin) 

Mother: Radio, (with t.iilint^ intonation) 

Child: [\ve-n| (with falliniMntonationi ^' 

^ McNeill (1970, p. 100) reports utipublished materiah from Roger Brown's re- 
search illustrating children's (usually shortened) imitations of adult sentences. 

Bohavioral Learning Theory 

The behavior {hei»ry developed'by Skiiuier (e.g.: 105,1) and his followers focuses 
on the properties of what are called operant responses and the conditions that 
are presumed to control their elicitafioii, learning, andcxfinction. The paradigin' 
of classical conditioning is played down in this thetiry because it is tiiought to ^ 
pertain mainly to responses of the autonomic nervous system, responses that are 
considered nof to be of primary interest in educational .settings. Discussions of 
classfcal conditioning rarely figure in writings about the application of behavior 
theory in instructioti (Skinner, 1968). - 

The salient feature of behavior theory is its treatment of the relations among 
stimuli, overt responses, and remforcements. In the -strict form of behavior 
theory, mental events and covert responses are assumed to be of no scien-tific 
interest: and -re therefore not considered. It is assumed that changes in proba- 
bilities of enu .)ion of overt responses are tunctionally related to the occurrence. 
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at specifiable points of time, of ''reinforcements" stimuli tending to satisfy 
•* drives , and, as the case may be-, also to the oc\'urrence of certain other stimuli 
("discriminative stinnili'') that may serve as cues for the emission of the overt 
responses. The overt responses" th is come under the ''control" of reinforcehients 
and discriminative stimuli when the temporal relations and other conditions are 
as prescribed by tlie theory. The theory is also much concerned with the 
"topography" of the responses, i.e., with their differentiation, and with the 
manner in which rewards and also discriminative stimuli are differentiated. 

It is useful to see how the assumptions of behavior theory compare with those 
of naive theory: 

1. Behavior theory agrees that the learner must be motivated, but it sees the 
problem of motivation as one of identifying drives for which reinforcers can be 
specified. Many applications of behavior theory involve reinforcements for basic 
drives such as hanger and thirst, but according to the 'Tremack principle" 
(195^)) any activity preferred by a learner can serve as a reinforcer for any 
less-preferred activity. Thus, in conducting "programmed instruction," getting 
thrtnigh a program might be regarded as a reinforcer for the act of going through 
a program, on the assumption that the student would rather not be doing a 
program than doing it. 

2. Any consideration of "attention" or conscious control of learning is not 
recognized in behavior theory. The principle of "one thing at a time," however, 
is utilized in behavior theory simply because of the necessity to establish precise 
temporal relations between particular responses and particular rewards. 

3. The only thing that behavior theory recognizes as being learned is some 
overt response (or some integrated combination of responses), which occurs 
under appropriate circumstances or stimulus conditions. A strict form of behav-. 
ior theor>' makes no assumptions about "information," "memories," "knowl- 
edge," or even "habits," although if a resporise is "reliably" established it is 
sometirnes loosely referred to as a habitual response. 

4. Matters having t\) do with the practice of responses and repeated exposures 
tp stimuli are dealt with under the rubric of "schedules of reinforcement," i.e., 
vv'ith the specification of the temporal relations and repetitions of stimuli, 
responses, and reinforcing events. Some schedules are found more effective-in 
producing learning than others. ^'Forgetting" of responses would be interpreted 
as extinction of those responses resulting from an ineffective schedule of 
reinforcement. 

5. Feedback is considered to.be a form of reinforcement; it applies to the 
learner's response, not to the learner. V 

6. Reward is obviously of central importance; like feedback, it applies to the 
learner's response and, not to the learner. Positive reinforcements are believed to 
be more effective thaiT- negative ones; insofar as feedback regarding incorrect 
responses^is aversive, the conditions for learning should be arranged so that the 
learner makes a minimum of errors. 
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7. In- the theory, there is no such thing as prior knowledge; there are only 
behaviors and responses that have been learned previously. These previously 
learned resoonses are to be taken account of as "baseline" or "entry" behaviors 
which may in fiict be prerequisite for further learning and for building integrated 
"response repertoires." 

8. Since only overt responses are learned, learning is obviously "active." The 
prescriptions of naive theory about active learning are interpreted as referring to 
the necessity of "fading" irrelevant cues. 

Despite a good deal of publicity and experimentation, it can hardly. be said 
that behavior theory has 'become popular with all language teachers. However, 
the advent of a strict behavior theory was perhaps the precipitating factor in 
various investigators' attempts to teach some kind of language system to lower 
animals, specifically, .chimpanzees.^ Nevertheless, it is not clear that behavior 
theory was responsible for the successes of these investigators, such as they have 
been. The Gardners state that although they recognized the theoretical weak- 
nesses of the behavioristic paradigm, they "never hesitated to apply those 
principles^of reward theory that were relevant," but they cite a number of other 
teaching techniques (guidance, observational learning) that were generally more 
effective than straightforward instrumental conditioning procedures (Gardner & 
Gardner, 1971). It is obvious that Rumbaugh and his associates and the Pre- 
macks were strongly influenced by behavior theory in their work with animals, 
using standard instrumental conditioning techniques at least in the earlier phases 
of their work. Nevertheless, the learning behavior of the animals had many 
^ features that could not have been expected or easily ^^ccounted for by behavior 
theory. For example, Lana (the chimpanzee tau^t by Rumbaugh and his, 
associates) would every once in a while make a mistake jvhile she was punching a 
sentence into the coniputer; all by herself she discovered a "correction proce- 
dure" for canceling the input of such a sentence when she "knew" she had made 
a mjstake. 

Behavior theory has inspired the generation of instructional theorists who 
developed "programnied instr^ction" (Glaser. n)65): it has also been a source of 
guidance- in the development of "behavior .modification" techniques for chang- 
ing children's language behavior (Hart & Risley, 1974; Sapon, 1969). One very 
explicit use of behavior theory is that of Mear (1971) for establishing "receptive 
repertoires" in children learning French. v.,,; - ' " 

'(iardncr and (uirdner fl97i.) taught a version of American Sign Language, the sign 
languase of the deaf, to a female chimpanzee named Washoe. 'Hie Premacks( Pre mack, 
1971; Prcmack & Premack, 1972) taught a chimpanzee named Sarah to use a ^language" in 
vvliich pieces of plastic of dilTcrcnt colors and shapes were used to communicate simple 
ideas ab(Hit eating, foods, etc. Rumbaugh. (lill, Hrown, von Glascrsfeld, Pisani, Warner, and 
Hell (1973) taught a chimpanzee namctl I ana to use a lariguage in which sentences wcfc 
composed of visual symbols ("lexigram.s''); a computer was used to control the displays of 
these lexigrams. which could "be produced either by the experimenter or by Lana, by the 
punching of buttons in the proper sequence. 
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Thus, behavior theory has been highly successful in many ways. By concentrat- 
ing on directly observable events, it has achieved a kind of scientific respectability 
that was not achieved by previous learning theories, certainly not by any 
kind of naive theory. More importantly for our present purposes, it has served as 
a filtering device for sorting out critical elements and. problems in learning 
theory. But in this respect it ha$ revealed its weaknesses. There is a lingering 
appearance of circularity in a theory of reinforcement that seems to define 
reinforcers in terms of drives and drives in terms of reinforcers, but there are 
other matters to worry about. The major gaps in the theory are its inability to 
de^l with covert events that are undoubtedly relevant in learning and its failure 
to recognize that reinforcers have their effect not on responses as such but on 
the covert events that antecede and trigger overt responses. It has no satisfactory 
theory of knowledge and information processing, nor of the parameters of 
memory structures that would presumably underlie the surface "laws" of rein- 
forcement schedules. From a practical viewpoint, it has only a limited theory of 
the manner in which responses get emitted, so that the practitioner is often hard 
put to identify or elicit responses that can serve as a basis for further learning. 
The Gardners might have had to wait for an eternity before observing responses 
that could serve as the basis for communicative "mands,'' if they had not in the 
meantime discovered that guidance or "molding" (Fouts, 1972) could shape 
such responses.^ From the reports published tlius far, there is apparently no 
means of knowing how much "guidance" the Premacks had to give their 
chimpanzee Sarah in order to get her to make the responses she did. 

Tv/o fundamental questions about behavior learning theory are: (a) does 
itaniing truly take place on the basis of solely the variables indicated by the 
theory?, and (b) when language responses are acquired or modified by behavior 
modification techniques, is this learning of the same chara::ter, resulting in the 
same kind of competence, as occurs in normal language learning? I believe that 
the answers to both these questions are in the negative. The bulk of the evidence 
as to what goes on in the' so-called "verbal conditioning" paradigm is that a 
change of behavior occurs only when subjects are consciously aware of, and 
pleasantly disposed towards, the arranged contingencies (e.g., Sallows, Dawes, & 
Lichtenstein, 1971). Weiss and Born (1967) doubl that "speech training" con-^ 
^ducted according to behavior modification theory results in true language 
acquisition. 



Cognitive Learning Theory 

I am not aware that any reasonably adequate cognitive theory of learning has yet 
been developed. I would entertain the hypothesis, however, that such a theory 



^ A mandt according to Skinner's f 1957) account, is a verbal response that, though initially 
occurring with no such function, has been" conditioned to communicate some desire or 
motive C'damarid''' ''command'") on the part of tlie learner. . 
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would provide a much huproved basis for interpreting language learning phenom- 
ena and' for suggesting measures for promoting language skills. By '^-ognitive 

.theorv''' I mean. a theory that would embrace covert events such as expectancies, 
plans, set.s images, memory storage and retrieval, conscious control, and com- 

' plex intbmrjtion processing. I assume that contemporary experimental technol- 
ogy (as represented for example by reaction time studies, cojnputer simulations 
of behavior, etc.) has means for elevating these concepts to scientific respecta- 
bility.. 

Let us see how a cognitive theory might deal with the major points of what I 
"have called a naive learning theory, and incidentally how it would reinterpret the 
kinds of observations and procedures that jesult from investigations based on 
behavioj- theory. 

1. The concept of "motivation'' would be translated into terms of various 
kinds of internal events. Some of these would be associated with basic drives, 
that is, covert responses to changes in physiological states; others, however, 
might be labeled as conscious goals, plans of action to achieve those goals, and 
expectancies concerning future events, often in ccjgnitive respon.>e to particular 
situational requirements. ^'Motivation to learn" would be interpreted as an 
expectancy of some future state of knowledge or ability that would result from 
performance of a learning task, for example, the ability to communicate in a 
foreign language. Certain kinds of motivational states {intentions) would have a 
pcculiar^ importance in learning language. A comnnftiicative act involves the 
transmission of c&rtain aspects of the speaker's intentions to the cognitive 
information store of the hearer. Thete is ivi least inferential evidence for the 
involvement of/'intentions'' in the communicative acts of the chimpanzees who 
have been .studied by the Gardners and-by Ruhnbaugh and his colleagues. Washoe 
communicated her desires for more tickling, more banana, etc. by using the sign , 
for more (Gardner & Gardner, 1969, p. 669). L.ana (Rumbaugh et al., 1973) 
communicated her desires (intentions) for j uice, the presence of her keeper, or 
even background music by various button-pushings. (Apparehtly the Premacks' - 
Sarah was never given the opportunity to communicate her desires.). Mear's 
(1971) tlrst-grade stutients learned to apprehend* the intentions of their teacher 
from her French vocal responses. ^ 

. 2. In contrast to behavior theory, but in agreement with naive theory, cogni- ' 
:tive theory' would acknowledge the importance . Vahention in l^jarning. Neisser 
(1967, pp. 292' ff.) writes of the.usefulness of assuming an '^executive process" 
in an information-processing theory , that control;^ the tlow of information by • 
' addressing particular sensorv' registers or memory stores. Cognitive theory would 
assume that attention is important at some point in the learning process, even 
though tt.s role might diminish after processes become automatized. Cognitive 
theory would agree with naive theory in asserting that '^motivation'' Ca&» de- 
scribed above) enhances attention. Expectation of reward, for example, might 
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do this; problem difficulty would also do so. Rumbaugh et al. (1973) used 
expectation of reward to direct Lana*s attenti<:)ri. to the separate parts of. visual 
messages. In learning the, conditional relationslnp, Sarah is reported by the 
Premacks (1972) to have been led to ''j^ay closer attention to the sentences/' 
apparently because of difficulty experienced with, the problem. 

3. Cognitive theory would for th? most part agree with naive theory in 
asserting that information is what is learned, and would object to behavior 
theory's postulation that it . is the responses that are learned. According to 
tognitive theory, learning to ^?2aA:e particular responses is an internal process, as 
is also'' a decision to emit them on a parncular occasion an'd under particular 
conditions. Cognitive theory would provide for the automatization of response 
emission by assuming that information transfer processes can become extremely 
rapid and that cognitive sets are not necessarily always directly under thg control 
oi the executive. (In fact, an important feature of cognitive' theory is i s 
emphasis on the extreme rapidity c f most cognitive processes.) Cognitive theory 
v/ould further agree with naive theory in assuming that'in formation can come 

o.from a great variety of sources-'through any sensory modality, but it would lay 
stress on how this infofniation is evaluated and possibly transformed by tl^e 
central processor. It would also be concerned with situational contexts in which 
different kinds of information are arriving simultaneously and are evaluated in 
terms of each other. Learning the meanings of signs would be a special case of 
such prodessing, resulting (under suitable conditions^ in "some kind of awareness 
that "X means Y.'' In fact, the very concept- of naming would be a special 
algorithm used in processing many types of information. Note that Sarah 
(Premack & Premack, 1972) was able to learn a sign for this concept, in a sen^e, 
a second-order, "metalinguistic" concept. (One may speculate, therefore; thato 
the Gardners' Vvashbe acquired this concept and could 'easily have learned a sign^ 
for it if the proper contingencies had been arranged.) 

4. In cognitive theory^ the effects of practice and repetition would be handled 
through reference , to the parameters of various memory systems and to the 
•"cognitive states occurring during practice and repetition. It'would be an interest- 
in^cxerctkl^ to reexamine the extensive literature on tlie subject from this point of 
view, 4n this way it might be possible to search for explanations of the fact that 
practice and repetition -iire not universally effective in promoting learning. It could 
be hoped that cognitive theory would extensively refine the a.^scuions^ of naive 

. learning theory, - 

5. Feedback and correction, in cognitive th^oryvwould be legarded as merely' 
one kind of information contributing to learninc~though frequently impor- 
tant kind of information. - • 

6. Rewards'and reinforcers (lucluding aversive stTmuli and their withdrawal) 
would merely consritute another kind, of informarion utilized in producing 
learning, but rewards would be neither universally necessary^ noj Sufficient. Their 
relevance is minimal, for example, in observational and incidental learning. 
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7. Previously acquired knowledge, stored in something other than short-term 
memory, would be regarded as important in learning to the extent that a 
particular learning process required use of that prior knowledge. 

^'Active learning'' might be important, in cognitive theory, to insure that 
knowledge or other kinds of learning are truly in long-term memory and not 
dependent on irrelevant eue.^ from sliort-term memory. 

In addition to all these points, cognitive learning theory would lay stress on 
the organism's interpretation and further processing of the information available 
to it at given points during an instructional or problem-solving episode. Particu- 
lar sequences and arrangements of stimuli in the instructional setting'would 
evoke different mental processes, some being more conducive to learning than 
others. The Premacks (1972) seemed to be keenly aware of this in their 
speculations regarding what instructional sequences might be most productive of 
learnmg in Saraii. In teaching language concepts, it seemed tp be most useful to 
present two positive instances and two negative instances. One may hypothesize 
that such an arrangement provided Sarah with precisely the information that Was 
both necessary and sufficient to define the concept. The common features in the 
positive instances were perceived as defining the concept only when they were 
seen as coi^ra^sting with the common features in the negative instances. The way 
in which information to be processed must be adequately presented is also 
illustrated in the teaching of the if-thon conditional sign. Before teaching tin's 
sign, it was necessary to establish a referent for it, namely a set of situations in 
which a contingency was present. The Premacks' teaching of the conditional sign 
to Sarah is almost precisely parallel to the manner in which Bereiter (Bereiter & 
Fngelmann. 1966) taught the meaning of if io disadvantaged children. He clid 
this by setting up on the blackboard several situations demonstrating a contin- 
gency: If a a square is red, it is little; if a square is green, it is big; etc. From this 
it was easy to move to teaching the meaning of the word. 

CAN LANGUAGE SKILLS BE PROIVIOTED?-^ 
ANSWERS FROM, COGNITIVE THEORY 

If if has been possible to develop a ''behavioral technology" based for the most 
part on reinforcement theory, it may also be possible to formulate a cognitive 
learning technology, with a much broader base in information-processing theory, 
that would be more generally applicable, more efficacious, and, perhaps, more 
"humane" than behavioral technology. Such a technology would. I believe, be a 
better guide to tfie promotion of i mguage skills. 

Il has become fashionable, in recent years, to speak \?ir\%\\'dgQ acquisition 
rather than language learning, at least in reference to child language. Apparently, 
tills weasel word is used to dodge the question of whether language is actually 
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"learned." Indeed, it has been suggested that it is "acquired" through some sort 
of "language acquisition device" (LAD) that is innately specific to the humiin 
species (Lenneborg, 1^)67; McNeill, 1970). The hypotl\eses of language acquisi- 
tion device and of species specificity are becoming mote suspect in view of the 
recent findings with Washoe, Lana, and Sarah. I forego discussion of whether 
these animals attained systems with all the essential properties of human lan- 
guage, partly because the data are not all in (for discussion of this point, see 
Bronowski & Bellugi, 1970; McNeill, 1974). We have little information as to the 
full range of Washoe's comprehension of American Sign Language, and at this ' 
writing studies with Lana and Sarah (or their friends) are still in progression the 
basis of my analysis of instructional episod.es with these animals, I suggest that it 
should be possible to teach chimpanzees languages more closely related to the 
human language than those thus far taUght. For example, Washoe could have 
been taught a sign for the concept name-of, for Sarah learned this concept quite 
readily. Sarah, in turn, could possibly have been taught a language system with a 
complexity approaching that of natural language- rather than the relatively, 
"telegraphic" syntax that was taught. 

If language systems can be taught to primates, it would seem that they could 
certainly be taught to human children, but ordinarily one does not think of any 
need to teach a child his native language, since he seems to learn it by himself or 
herself. Of course there are some children who for one reason or another 
(deafness, autism, etc.) do not "acquire" language in the normal manner and 
who p>Q§ent serious learning problems. Possibly a cognitive learning technology 
could contribute towards the solution of such problems, even more than behav- 
ioral technology has already contributed. Even in the case of "normal" children, 
there are variations in rate of language development; we know very little about 
the causes pf such variations. To the extent that such variation might be 
genetically determined, there is little that the cognitive learning technologist can 
do about them. To the extent that they might have environmental antecedents 
(as they very, likely do), the cognitivist might suggest procedures by which 
retarded development could be remedied. The essential need at this time is to 
start applying cognitive learning theory more seriously in research on child 
language learning (and I use that word advisedly), not only to explore possible 
iipplications but also to refine the theory itself. Similarly, cognitive learning 
theory could inspire research on second-language learning (Carroll, 1974b). 

Several lines of theoretical and empirical investigation may be suggested. A 
further analysis of the experiments with animals would clarify cognitive language 
learning theory because these experiments involve organisms that do not ordi- 
narily possess anything like' human language: since they cannot be said to possess 
a language acquisition device like that of human beings, the special procedures 
that have been used to teach animals language must exemplify arrangements that 
cause learning rather than a fulfillment of maturational possibilities. 
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Thea* \s alsi) great need and opportunity io reanalyze and reinterpret, from a 
cognitive learning standpoint/findings iVom studies ofciiild language acquisition, 
rhe research strateg\ should be to see how nnich the role of a language 
acquisition device can be delinuted and how nuich the role of learning c;in be 
amplilled. 

Take, for example, the concept of imitatuin, tlie-^latus of which has had an 
interesting history in the study t)f child languagc^-'learning. Hnshriiled as an 
important concept in naive learning theory, and interpreted in terms of *'echoic 
operants'* in behavior theory, the concept has generally been downgraded in 
importance by specialists m child language study. Ervin-Tripp (1964) at one 
point says, "... there is not-a shred of evidence supporting a view that progress 
toward adult norms of grammar arises merely from practice in overt imitation of 
aduh sentences [p. 172] r Yet Hrvin-Tripp and others (Slobm, 1968) have used 
unitation tasks extensively to study grammatical development. The problem is 
partly semantic: on the one hand, ^'imitation*' can refer to an alleged learning 
process; on the other, it can refer to an observed behavior. But the problem lies 
illso in a confusion about what is imitated. It seems almost certain that children 
imitate, or try to imitate/elements such as intonation patterns or single words. 
They can alsQ imitate longer segments, or parts of these segments, but only 
within niemorylimitations and the competence they have already achieved.. ir 
the concept or process of imitation is to be used in explaining or promoting 
language acquisition, it must he considered as only one process among possibly 
many others. Bloom, Hood, and Liglubown ( 1974) suggest: *'One might explain 
imitation as a form of encoding that continues the processing of information 
that is necessary for the representation of linguistic schefnas (both semantic and 
syntactic) in cognitive memory [p. 418] 

A further analysis of imitation in terms"of cognitive theory might deal with the 
manner in which sensory information from the person or utteraace being 
imitated is transformed into memory templates and, conversely, how memory 
templates for phonetic material are manifested in motor performance (Posner & 
Keelc, 1^)73, pp. S24-H25). Temporal parameters may be important in imita- 
tion. The Gardners (1^)71') speculated that some of Washoe's learning resulted 
Worn what they called delayed imitation; that is, Washoe's imitations of signs ^" 
sometimes did not occur until long after the o.riginal observations. A process of 
delayed imitation might account for the observation that children sometimes 
ciuiie out with a new word or granmiatical structure ''overnight,*' long after 
original exposure to models. 

Britt(jn (1070) remarks that '1t would seem to be nearer the truth to say that 
(children) imitate people\s method of ^^oing about saying things than that they 
imitate the things said [p. 42)/' Such an imitative process would account for 
improvisations like "Pm spopniulling it in" or ^Tm jumper than you are," all 
based on the imitation of speech patterns. that the child observes. 
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, If we regard language production as ti process of converting jntentions into 
speech, it (^t'ten presents features of problem Solving: the child uses whatever 
methods he may have acquired that seem reasonable in this kind of problem 
solving. Promoting language skills might entail teaching children useful methods 
for expressing their intentions. 
.• c 

SOME BRIEF BUT DIFFICULT PRESCRIPTIONS 

The instructional prescriptions I have to differ will sound rather similar to those 
of the behavioral technologists, but I hope the reader will appreciate the subtle 
but essential difference in theoretical outlook. 

Like the behavioral technologists, I recommend careful analysis of what is to 
be learned usually, analysis into rather small units, but also analysis in terms of 
whatever larger structures iTiay seem relevant. The analysis,' however, is to be 
made in terms of information, and only secondarily in terms of overt responses 
to be made on the basis of that information. In the case of language skills, the 
analysis of information to be learned will have much to say about the stimulus 
ct)nditions that correspond [o meanings and communicative intentions, and the 
linguistic constrxiints whereby those meanings and communicative intentions are 
manifested in overt behavior in a particular language system. 

In the preparation of instructional materials and procedures, careful attention,, 
is to be paid to the manner in which the relevant information is presented to the 
leamer. Account mast be taken of what prior information can reliably be 
presumed to be available to the Iqanter at any given point. There must be great 
aincern with exactly what new information is presented from moment to 
moment in the instruction, with reference to what processing of thot informa- 
tion is likely to be perfonned by the learner. This information processing should 
be of a nature desired by the instructor. 

In the actual process oltteaching, the learner should be prepared for what he is 
learning by evoking apprcij^iate sets and expectancies that >yill direct and focus 
his or her attention on particular units of information. Information .about the 
manner in whiclvnew information fits in with the overall structure of what is to 
be learned, and its relevance to more general goals of the learner, would be 
incorporated in the Ibamhig situation.. Instead of speaking of reinforcement. We 
should speak of the role that certain types of information can serve in directing 
the cognitive processes c^f the learner [support for this type pf prescription can 
be found, for example, in recent papers by Bindra (1974) and Boneau (1974)] . 

The planning of instructional sequences over stretches of time requires consid- 
eration of the ''cognitive history'' of new information in terms of its probable 
course through various memory systems. Although as yet we know little about 
' the properties of memory systems, an ideal cognitive history of any element oT 
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information to be learned might be something Hke this: In a first phase, 
presentations would concentrate orj obtaining increased clarity and definition of 
the learner*s perceptions of stimulus materials, leading to a point when the 
thing-to-be-learned receives the greatest possible attention from an **executive" 
element. In a second phase, the inibrmation is processed through short-term 
memory and ever^tually into long-term memory, passing into a state where it no 
longer needs to be dealt with by an executive in the focus of attention; it 
becomes, however, more and more readily accessible from long-term memory" 
and thus acquires a characteristic of autonjiiticity. 

Throughout this discussion, it is assumed ''that account will be taken of 
individual' differences in learners. In a recent pai)er (Carroll, in press) I have 
suggested that individual differences in the performance of cognitive tasks are 
refiections of parameters of memory stores and of the production systems that 
control the How of information in a total memory model. 

I have discussed three types of theory that miglU apply to the promotion of 
language skills. Obviously, I favor cognitive learning theory. I fedr, however, that 
my formulations will remain ianciful until they prove productive of improved 
instructional outcomes- 
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For some years 1 have worked at untangling and measuring independent cogni- 
tive skills in beginning reading (Caifee, in press). The goal of this work was 
threefold: (a) to create a theoretical model (or models) to describe the process 
by which the ability to read is acquired, {b) to use this model to develop a 
system of assessment instruments, each providing independent^ unique sources 
o.f information to the classroom teacher and other individuals responsible for 
evaluation of a beginning reader, and (c) to establish the feasibility of indepen- 
dent instructional modules. Given solid evidence for independent stages in the 
a^cquisition of reading,^ then perhaps these can- be handled instructionally as 
separate matters, contrary to the current practice of trying to handle everything 
at once. 

Briefly, my previous efforts focussed on the development of "clean" tests, in 
which there was some assurance that ancillary task requirements (understanding 
instructions, familiarity with materials) were eliminated as differential sources of 
variability between children. Multiple regression served as an analytic tool for 
determining the independent contribution of various precursor tests for predict- 
ing criterion performance in reading achievement (Caifee, 1972; Caifee, Chap- 
man, & Venezky, 1972). I 

More recently \ have been thinking about the general question of what is 
meant by independence of cogniUve processes, and the related question of how 
we might test various sources of independence. Sternberg (1969) was the first to 
point out the central im'portance of independence to information-processing 
models. His presentation was quite clear and has served as a basis for a great deal 
of fruitful research on cognidon. However, I now realize that several different 
intetpretarions of independence have been intertwined in my thinking and, I 
suspect, in the thinking of other invesrigators as well. 
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In this chapter, [ will first present a generali/ation of Sternberg's additive- 
factor paradigm for testing stage independence. Next, I will turn to the question 
of how to evaluate individual differences in an independent-process analysis, and 
will present a unified framework for testing dilTerent classes of hypotheses about 
the independence of cognitive processes. An illustration of these techniques will 
dien' be discussed. Finally^ some implications of this work for test design wilj be 
pointed out. 

This chapter deals with assessment of instruction, rather than with methods of 
instruction, and hence is most readily' applicable to test design and interpretation 
of test data. But assessment is intimately interwoven with the development of 
substiuitive theories of instruction. A process-oriented assessment system should 
help us understand how a student thinks when he is learning something. This 
allows us to formulate reasonable hypotheses about the character of efficient 
instructional strategics, and to evaluate the effects of variation in instructional" 
strategy. 



STERNBERG'S ADDITIVE-FACTOR PARADIGM 

It has been the fashion for the past several years among cognitive psychologists 
to represent theoretical ideas, in the form of How charts or block diagrams, 
Sternberg (1969) pointed out that, if this activity was- to be taken seriously, it 
was necessary to demonstrate the functional independence of the processes 
repa^sented by different bh>cks in the system. He presented a methodology for 
showing process independence i'or the case of a single additive measure, reaction 
time. 

The fii'st step in this paradigm is the analysis of the underlying cognitive 
operations required to perform a task. This provides a rudimentary information- 
processing model. The next step is to identify one or more factors uniquely 
associated with each operation. Then a procedure is developed in which it seems 
reasonable to suppose that the operations are carried out as a series of stages, 
one following the other. Tlie- total time to perform the task is the sum of the 
times taken by each stager 

' For example, consider a task in which a subject is asked to read a list of words, 
and to memori/c them so that he can recall them after a delay interval. The list 
is long, and during the delay interval the subject is distracted in some way, .so the 
task requires more than short-term memor>'. The subject oan otudy the list for as 
long as h§ wishes: the study time is the primary dependent measure. 

The first step is to specify the mental operations required to perform the task. 
The model in Fig, i appears reascnuible fiir this situation. The subject uses some 
time to read each word in the list and some more time adding the word to an 
organized semantic structure which aids later recall. 
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FIG. 1 Relation ut' factors to processes in "sludy" model. 

The next step is to identify one or more factors that should have a unique 
effect on a given stage. In Fig. 1 , one such factor is suggested for each stage. We 
then construct a factorial design around these variables; a subject is given word . 
lists containing familiar or unfamiliar words which are either easy or difficult to 
categorize. 

If the processes in Fig. 1 are sequentially independent, and if the assignment of 
factors to processes is appropriate, then a rigorous test of the model is possible: 
there should be no interaction between factors associated with different stages. 

This conclusion is reached as follows. Assume it takes / seconds to read a list 
of familiar words, and ;/ seconds to read a list of unfamiliar words, and that/< 
u. Similarly, the time, t% to organise an easily categoiizable list is assumed to be 
less than the time, for a list that is difficult to categorize. Then the 
■independent-process hypothesis predicts that for each type of list specified by 
the design factors, study time should be the sum of the component times. The 
prediction is shown in Fig. 2 algebraically and graphically. 

An observable feature of this prediction is that the data should trace out 
parallel functions. The effect of the categorizability factor should be the same at 
both leyels of the familiarity factor. Any other result-any deviation from 
parallel functions - is -evidence of an interaction, which would mean that the 
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FIG. 2 Aii.ajbraic and jiraphical predictions based on "study" model with two independent 
procx2sses. 
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th^retical analysis is faulty at some point. In this event, general statements 
about the effects of either factor are impossible, since the effects of one factor 
vary from level to level of the other factor. 



A GENERALIZATION OF THE ADDITIVE-FACTOR PARADIGM 

A representative- of a generalized process model is shown in Fig. 3. Processes A, 
B, and C are assumed to be cognitive operations underlying the performance of 
some task. To establish the independence of these processes,* it is necessary to 
associate with each process ?i factor set and a measure set. A factor set consists 
of one or more independent variables, variation in which is presumed to 
influence the corresponding process and that process only. A measure set 
consists of one or more dependent variables, each of which reflects the operation 
of the corresponding process and that process only. In other words, for a process 
model to serve any useful purpose theoretically or practically, we ought to be 
able to specify the input-^output features of each procqss ~ whatsorts of variables 
affect the processes, and how can its operation be measured? If every factor 
interacts with every other factor, and if we have no clear-cut way of meas^uring 
the underlying processes, so that every measure correlates with every other 
measure, we have gained little understanding no matter how elaborate our flow 
charts. 

How is a model like that in 'Fig. 3 to be tested? It requires a multifactor 
experiment with multivariate "measures, in which each subject is tested under a 
variety of combinations of factors from each of the' factor sets, and a variety of 
measures takert under each combination to provide links to each component 
process.^ 

Thrpughout this chapter we consider only designs with two processes, two 
two-lever factors in each set, and a single measure for each process. This implies 
a 2^ design, in which each subject is tested 16 times, once on each of the 
factorial combinations. Two measures are taken under each combination. Only 
main effects and two-way interactions are discussed since these suffice to test 
the model and to describe fully the operation of each process^ 

' 'Thtj t6rm, process, is used extensively and more or less uncritically throughout tliis 
paper, to refer io a mental operation of sonic kind. Stage has been avoided because of the 
"""possible' confusion with devolopmenta) stages. Process independence is a property of a 
-particuiar ■ task foT subjects uf a given sort. There is no effort to deal with the question of 
whether "independent processes" might be structural in nature, the result of learning, oi ^ 
situation specific. Finally, process independence does not imply instructional independenqe, 
iilthough as suggested earlier this is a possibility worth pursuing. 

^The present proposal is intended only as a generalization of Sternberg's ideas, not a 
replacement. In particular, single-measure analysis remains an important technique for 
investigation of process independence. This includes additive measuresMike reaction time," 
but might be usefully extended to multiplication measures like proportions (Calfee, 1970). 
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FIG. 3 A generalizaliDn nl the independent-process model. Associated with each compos 
ncnt process is a set of factors and a set of 'measures, each assumed to be uniquely linked to 
the prtjcess. . 

Tlie details of the design are spelled out in Fig. 4. The sixteen cells are labeled 
according to the four factors, two in each factor set. Below the design are 
contrast coefficients for the computation of the linear contrast for that source. 
These will be discussed shortly. Below that the data are represented in a general 
way. The indices / to / serve as usuiil to denote levels of the factors A through B . 
The m and n indices denote a particular measure {a or b t'orrespondingc^to • 
process A or B, respectively) and subject, 

In Fig. 5. is the general linear factorial model for the design. Each observation 
is fully accounted for by this set of parameters. The methods of estimating the 
parameters is well known, and will not be dealt with here in any detail. 

There are several ways to carry out an analysis of variance for the data set in 
Fig. 4 based on the model in Fig. 5. The most convenient method for present 
purposes is based on linear contrasts (Dayton; 1970, pp. 37-48, 78-81, 256- 
268). it is possible to express the magnitude of each source as a one-degree-of- 
freedom linear contrast on tlie data. For instance, the A source (the main effect 
of the A factor) is the difference between the A i'i\ndA2 scores; the /I' source.is 
the difference between /"i,' and /I2', and so on. These contrasts are repre- 
sented by the corresponding sets of coefficient)Sv c. in Fig. 4. In a factorial 
design, the two-way interaction between factors is the crossproduct of the two 
sets of coefficients. The coefficients for the AA' interaction, source in Fig. 4 
were generated in this fashion. 

The contrast coefficients a^re used to calculate a set of orthogonal parameter 
estimates from each subject s raw data. The magnitude of source S for a given 
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^ijkl,m,n ~ Mean of measure m ^ 

^ ^i\rn *** ^'i,m ^^sa )il,m l iTocts iif fuel or set A 

(byvi"<J^'P^tieii^*<-% negligibly ifm = b) 
+ ^/c.m + ^'l,ni + fA'J')A:/.m KHccts of factor set B 

(by independence, negligible if m =a) 
+ {aii)ii^fn ^o'V')//,^ Joint effects of A. and B 

Jby independence, these should always 
be negligible) 

+ Vff^ fj Geneial effect for subject // 

+ {av)ij,fi fj + . . . + iactv^jj fjj fi Subject-treatment effects of A 

(negligible if //J = /?) 
+ (^y)^ „j -yi + . . . + iiiii'v)kl,m.n Subject-treatment effects of B 

(negligible if m =a) 
+ (ctiiv)if^ rn,n • • • ^<^'^'^^il,in,ti Subject-treatment effects of A and B 

V (should always be negligible) 
+ t iji^i f^i ji Residual error 

FIG. 5 The general linear factorial model for the design in Fig. 4. 

measure, m, and a particular Subject, is computed from the contrast coeffi- 
cients for that source and the set of observations on, the given measure for that 
subject: 



C 



S, m, n 



' For 2^ designs like the one un 
a simple difference score; the 
regardless of the choice of coe 



^ JL (cs,iiki,mf' 



iilkl 

I 

del discussion, the numerator of each contrast is 
denominal^or normalizes the expression so that 
fficients the variance of the contrast is equal to 
the pop^iilation variance under tl^ie null hypothesis. 

There is a 'direct correspondence between the variance estimate of a source by 
means of a linear contilist and the parameters from the linear model (Fig. 5), the 
latter serving often to teach analysis of variance in statistics courses. The 
variance estimate for source S over subjects^ MS (5), is based on the average of 
the corresponding contrasts, C-y^^ .. This average, squared and multiplied by tlae 
c Qumbcr of subjects, is equal to the MS(S). If the null hypothesis holds for source 
S, then MSfS) is an estimate of the population variance. The residual variance in 
the contrast scores for source S provides a seqond estimate of the 
population variance. The two variance estimates generate an F ratio to test the 
plausibility of the null hypothesis. 

The point to emphasi/.C here is that tlie linear contrast provides a convenient 
method for representing each independent parameter estimate in the general 
linear factorial model in Fig. 5. The procedure, in its essentials, is to compute 
each estimate in the fonn of a normalized difference score for each subject. The 
. analysis of variance becomes, to all intents and purposes, an orthogonal collec- 
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tion of" ' tests on difference scores. This method is algebraically equivalent to a 
conventional repeated-measures analysis of variance. I am overlooking the use of 
multivariate analysis of variance aS an aiternative method of analysis, as well as 
questuMis about the dangers of relying on the acceptance of the null hypothesis 
as a way of supporting a substantive hypothesis. These are matters of some* 
concern, but they have been discussed elsewhere and are not central to the 
problem. 

Process lndependence~On the Averacj3 

I ^ • 

The major prediction of an independent-process model for data like that de- 
scribed in Fig. 4 is straightforward. The factor(s) associated with a given process^ 
can affect only the measufe(s) associated with the process. No other sources of 
variance should be substantial. The details are indicated to the right of Fig. 5. 
Variation in Factor A or A' or the interaction AA' m'ight be expected to 
substantially (and significantly) affect measure a\ these sources should not have 
any noticeable- effect on measure h. A similar state of affairs holds for factors 5 
and B' with regard to measure /;. Any interaction between the two factor sets is 
evidence against the independence of the processes, no matter which measure is 
affected. 

A concrete example may be useful at this point. This study (after Floyd, 
1^)72) is designed to investigate the processes by which young children read 
single words presented in isolation. 

The model for this task is shown in Fig. 6. Two processes are proposed: 
decoding and semantic matching. Reading is conceived as an initial translation of 
the printed word into an auditory form, then a search in memory for a lexical 



STIMUI US 




9p 



SEMANTIC 
MAfCHINti . 



FiESPONSE , 



PH()N(!Nt.!ArinN 



Mt ANtN(inJL 
ASSOCIATION 



FIG. 6 Kvimplc nt a two-prtuess model for rreudinp a word in isohition. (After Moyd, 
1972 ) 
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match For each process, a factor set and a measure set are suggested. The 
stimulus words comprise factorial combinations of all the factors shown. The 
subject's task is- to pronounce each word, and then to give-an associate to the* * 
word. If the pronunciation is incorrect, (he proper pronunciation is provided by 
the tester. Otherwise the measures would' be dependent of necessity. If a child 
failed^ to pronounce a word correctly, then subsequent associations would 
necessarily be strange. \ 

The predictions, assuming that decoding and semantic matching are indepen- 
dent processes, are as follows: pronunciation should be^affected by orthographic 
factors^ and wOrd ass'.)ciation should depend on semai"^tic factors. The testis not 
a trivial one in this instance; for example frequency is thought by many 
investigators to have substantial effects on 'VoM recognition," which presum- 
ably includes the ability to pronounce a word. 

To test these predictions, we compute for each source the appropriate "linear 
contrast for every ..individu^il subject. The aveiage of these Contrasts provides a 
measure of thn magnitude of this source over subjects. The residual variance 
between subjects ,n the contrast yields a measure of error variance for a test of 
statistical significance. The ratio ^ ' 

Af.S^( vowel complexity for pronunciation) . 



MS'{ subjects by vowcLcv^mplcxity for pronunciation) 

if statistically significant, would fit the hypothesis of process independence. The 
ratio 

_ AAV(vv()rd familiarity for pronunciation) 

^ AAS^{subjects by word familiarity for pronunciation) 

if significant, would be evidence against the hypothesis oil process independence. 

Process independence is evaluated here by the magnitude of the average effects 
due to a given source, compared to Between-sumect ^vaijiability in the source. 
This procedure provides a /easonably workable r/pproiich for testing the general 
independence (or depcndodcy) of the components of an ihformation-processing 
mo'del. If the empirical /esults fit the pattern predicted by the assignment of 
factors and measures to a postulated cognitive structure, wb have a parsimoai 
and useful way of unde/stmiding-how a subject performs the task. 



.^us 



Process Independence'— Individual Differences' 

Tlie preceding test M process independence involved comparison with an error 
variance estimate msed <in intlividual differences in subjects* performance on a 
particular contrast. Wliile it is- customary in research on cognition to treat 
uidividual diffore/ices as ''error'' (Hunt. Frost, & Lunnebocg, 197,3, and.CarroIl, 
1976, are excoi/tions: also, cf. Sternberg, 1969, pp. 307-3(j8), this is not an 
adequate treatment for educational research and practice. 
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Several distinctive sources of individual differences are represented in tiie 
general linear factonal model (Fig. 5). Half-way down the list are parameters, 
^m.« which measure subject /7*s general' performance level for measure m, 
averaged over all factorial combirtntions. Below that are subject-factor param- 
eters tor factor <et A, (cv'i^>, etc., next are the corresponding, 
parameters for factor set B, and finally the parameters for the interactions of 
these sets. As indicated in the figure, if the independent-process hypothesis is 
correct, only certain of these parameters should produce substantial variance 
estimates. 

For instance, suppose that for certain subjects factor y4 had a large effect on 
measure contrary to the process independence hypothesis, whereas for other 
subjects this effect was negligible. Then A/5(subjects by ^ for measure b) would 
be relatively large. MS(A for measure /?), which represents the general effect of 
the .4 factor on measure might be nonsignificant when compared to A/5(sub- 
jccts by A for measure h). Acceptance of the null hypothesis miglit be taken as 
evidence in support of general process independence -an erroneous conclusion, 
at least for some subjects. 

Ixirge variation between subjects in the parameters for a given source may 
cornpromi'se the interpretation of the overall variance source. The most obvious 
danger is that an unduly large error vari'imce estimate may obscure evidence 
contrary to the independent-process hypothesis. In this regard, comparison of 
variance components p/ovides a useful supplement to significance tests in the 
examination of data. ^ . 

Under certain conditions it is possible to test the hypothesis that a subject- 
factor variance estimate is larger than expected. The design must permit the 
estimation of a resiclual variance term; replication within subjects or pooling of 
high-order interactions often serves this purpose. The test compares each subject- 
factor source.with the residual error variance. For ex^imple, if 

// ~ A/jlsubjec ts by vowel complexity for pronunciation) 
AAVl residual error) 

ib a signiticant source of variance, this is compatible with the independence 
hypothesis. On the other hand, the finding that 

J.' ... {^/^^\^^^lu^'^;ts by wc^rd famili arity for pronunciation) 
' A/.SYresidual error) 

is highly significant constitutes evidence contrary to the hypothesis. Such tests 
are quite sensitive because of the large number of degrees of freedom for each 
^variance estimate. 

Subjecl-factur sources may provide the strongest evidence for or against 
process independence. If MV(subjects by vowel complexity for pronunciation) is 
large, then A/5'(vowcl complexity for prominciation) will seem relatively small, 
and may be insignificant. Such a result does not mean that vowel complexity has 
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no effect on the decoding process, but rather that the magnitude of that effect 
varies widely from subject to subject, in ways that are not controlled by the 
between-subject design. Simifarly, A/5(word familiarity by pronunciation) might 
be insignificant when tested against A/5(subjects by word familiarity for pronun- 
ciation). But if the latter variance is large relative to A/5(residual error), this is 
evidence contrary to process independence, just as surely as a large average effect 
is contrary evidence. 

Modification of a iVIodel 

The preceding discussion of statistical **tests" may imply a destructive approach, 
in which a model is proposed and then all efforts are directed toward question- 
ing its adequacy. In fact, the factor-process measure approach is self-correcting 
in the development of a model. Examination of a series of experiments provides 
positive information about the character of underlying processes, the specifica- 
tion of useful correspondences between factors and processes, and the descrip- 
tion of factors and measures in a precise, unconfounded manner. The results of 
each experiment lead to "perfecting" modifications in the basic model, which 
am be subjected to further test. * 

Parameter Independence 

To this point, independence has referred to the absence of interactions between 
factors associated with different processes. Closer examination of the question 
of individual differences reveals the existence of another type of independence, 
namely, the extent to which the parameters of the general linear factorial model 
are correlated. This property of a data set will be called parameter indepen- 
dence.'^ \ " . ' 

The idea of looking at the between-subjects correlation between a pair, of 
analysis-of-variance parameters is somewhat unconventional, but this appears to 
be a reasonable question to raise of a data set. Consider the linear contrasts 
^A.a.n '^^^^^ ^a'm.h '^^^^^^ ^^e difference scores for the A and A' factors for 
measure ff,- calculated for each subject n. Imagine that these pairs of scores are 
arranged in a scattergram. The previous analyses have dealt with the marginal 
distributions, asking whether the marginal means are zero, and whether the 
variance around each marginal mean is comparable in magnitude to an estimate 
of the population vaYiance. 

The size of the correlation between C^^ ^.n '<^^^ ^A\a,n, is therefore a new 
question, and statistically independent of the previous quesdons asked of the 

^To the best of niy knowledge, examination ot* the specifics of a varianec-covariance 
matrix along the lines suggested below has not been suggested before. Test for homogeneity 
of the matrix is a crude effort at best. Multivariate analysis of variance is mainly concerned 
with appropriate statistical inference when the dependent variable is a vector. 



ERIC 



42 



34 / ROBERT C.CAl n i 

ti ^ 

data/ A large correlation would mean that subjects who are .strongly affected by 
variation in factor A are also strongly affected by factor /l', and contrariwise. If 
the correlation is negligible, then the effects of the two factors are independent 
of each other, in the .sense that the knowledge that a subject is strongly affected 
by variation in one factor says nothing about his or her reaction to another 
factor. 

In the preceding example, the contrasts Ci.a,^ Ci'.u./j estimate param- 
eters for factors A and A' which linked to the same process. This analysis wiil be 
referred to as a test of intraproccss parameter mdependenvv. One can look at 
correltitions with interaction ccmtrasts as well as comparing main effect con- 
trasts, F'or instance, the correlation between C^x,a,n '^^^y.^ 0^i'.a,« asks whether 
the si/e of 'the effects of variation due to factor A are correlated with the 
magnitude of differential effects of A at the two levels of It should be 
stressetl that the correlation between contrasts is not the same as the interaction 
between factors. Moreover, one may examine these correlations regardless of the 
outcome of the analyses of the marginal distributions. 

It is also possible to examine the between-subject correlation of contrasts for. 
sources frorn two different processes: C^^^^.n '^^^^ ^^B,i},n* example. It is 
consistent with the process-independence hypothesis that both of these sets of 
contrasts could be significant sources of variance, either on the average or as 
subject-factor interactions; factor A is linked with measure a, and factor 5 with 
measure b. The nrignitude of the correlation between contrasts is a separate 
question, and has iro bearing on process independence. If two such contrasts are 
highly correlated, it means that a subject who is strongly affected by a factor in 
one process is likely to be strongly affected by another factor linked to a second 
process, whereas a subject showing little effect of one factor would not be much 
affected by variation in the other factor. This will be called an analysis of 
in terprocess indepcnden c\\ 

General Parameter hidependence 

There are two other types of independence to' be considered in examining 
individual differences. These are measured by the correlation (a) between general ' 
parameters, each based on , the average for a given measure over factorial 
conditions for an individual^subject; and (b) between general parameters and 
specific contrast parameters, if you refer to the general linear factorial model " 
(Fig. 5), the first correlation is between the estimates of v^J^,l and i^/,^,^. This is 
the correlation between the average scores for different dependent variables, 
which is frequently cjdculated by researchers. I will refer to this as independence 
o fgeii era! pararne ters. 

The correlation between general and specific parameters has been examined 
less often. It consists of the comparison of terms like and CA,a.n' Actually 
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for two-level factors tlie correlation of v^j ^ and (Xj fj is equivalent to the 
preceding correlation, and perhaps is a bit easier to grasp. The question raised 
here is whether subjects who do better on the average over all conditions also 
tend to be more strongly affected by factor variatimis. E-or example, the student 
who pronounc es words quite well on the average is strongly affected by vacation 
in vowel complexrty, whereas the student whose pronunciation is generally poor 
does about the same whether the words contain simple or complex vowels. I will 
refer to this analysis as a <est of the vidcpciidaicc of general and specijic 
[HJra meters. 

Sources of Dependency: An Overview 

h should be emphasized that the different types of independence described 
abi>ve arc statistically Separate, and that the answer to one question does not 
directly determine ans\vers to any other. That is. one can usefully inquire about 
each of the following substantive questions: . . 

1 . D-oeess independence, average over sith/ects: 

' Are any between-process sources of variance so large, on the average, that 
the hypothesis of process independence is untenable? 

2. Process independence, suhject-faclor interactions: 
Are. any betweeji-process subject-factor interactions so large that the 
hypothesis of process independence is untenable? 

3. Intraprocess parameter independence: 
Are effects of within-process factors correlated? 

4. Interprocess parameter independence: ^ ' 
Are effects of be tween-proce.<iS factors correlated? 

5. (fcneral parameter independence: 
Are total scores for different measures correlated? 

(v Cfvneral- specific parameter independence: 

Are the specific effects of process factors correlated with generalized 
performance as measured by total scores? 

The answers to these different questions carry different implications. Ques- 
tions (1) and (2) bear on the adequacy of a proposed information-processing 
model. Questions (3) and (4) have to do with the degree to which individual 
subjects are more or less generally labile in reaction to factor variation. Ques- 
tions (5) and (6) deal with the relation of general performance and process- 
linked shifts in performance. 

If process independence, ( I ) and (2), is supported by the data, this is evidence 
that assessment (and possibly instruction) may proceed by investigation of each 
process as a separable entity. For instance, suppose decoding and semantic 
matching operated as independent processes in a series of experiments. Then it 
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nuglit be reasonable to design assessment and instructional programs that 
tocussed specitlcally ou decoding skills, with minimal concern about the corre- 
sponding comprehension processes, and vice-versa. 

If answers to Questions {}) through (6) reveal iVeqnent and nuirked depen- 
dencies, this supports a 'Y/ factor'* interpretatii)n of indrvidiial differences in 
cognitive processes for the task. If strong ciirrelations hold feween measures in 
different tasks, there is little' need tor extensive assessment of an individual 
student. Administration of a tew ^'subtests" will indicate the student's general' 
level of performance, or his reaction to factiir variation, or both. From this we 
can predict his performance imder other conditions. On the other hand, if 
dependencies are negligible, the development of cimiprehensive assessment sys- 
tems becomes a wi^rthvvhile endeavor. 



AN EXPERIMENT ON LINE DRAWING 

Here is an illuslnuion j)f how t{) apply these techniques to a data set. The study 
was not designed to test an uidependent-process nujdel, and it seems unlikely 
that the treatment factors are uniquely linked to underlying processes. But the 
withm-subjects portion of the design raises interesting questions, and the data 
wera readily available for the analysis. 

The study was part of an investigation of impulsiyity-renoctivity in young 
cliildten {Kagan. Rosman, Day^ Albert, & Phillips, 1^)64). Some children seem to 
attack a pri^blem impulsively nu)re quickly and with a higher error rate. Others 
. tend to work rellectively more carefully and accurately. There is some evidence 
that imputsivitv is correlated with poorer reading achievement. Our particular 
interest was in determining the extent to which speed and accuracy measures 
were affected by situatiimal variables in a simple motor task. 

The children were shown a paper with half a do/cn items like the ones in Fig. 
7. and told that their job was to draw a line from each rabbit along the "road'' 
to the carrot without touching the lines. Time to complete all six items on a 
page was measured, as were the total number of line-touching errors. The 




FIG. 7 I Aamplc ot rnateridls iisod in linc-drawinj: task. 
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DRAWING ERRORS 



FIG. 8 liilormation-procttssing rnodcl for line-drti' wing exfieriment. 

children, first-graders arid kindergartners, were tested twice with three mpfiths or 
so betwci^n sessions. 

The two within-subi»^ct factors of primary interest are related in Fig. 8 to a 
tentative processing model. One process determines rate of movement, and the 
second process determines accuracy. Latency and errors seem natural measures 
for these' processes. 

The Scl factor describes the instructional conditions under which the child 
performed the task. The first two pages were always done with no set. The 
instructions emphasized neither speed nor accuracy: "Draw a line down each 
load from each bunny to his carrot. Try riot to touch the sides of the road. If 
you do touch the side of the road, it's okay, keep going, but try not to touch the 
lines."" On the next two pages, accuracy was stressed.: "Be very, very careful not 
to touch the sides of the road." Finally on the last two pages, the child was 
asked to draw as fast as possible: "Get each bunny to his carrot as quickly as 
possible. Try not to touch the 5ides of the road, but if you do, it doesn't matter, 
the important thing is to complete the page as quickly as possible." Set and 
order are confounded in this design as a matter of practical necessity. 

The Diffiadty factor denotes whether each page had easy items (the lines 
connecting rabbit and cajrot were 5/8 inch apart) or difficult items (the lines : 
were 1/4 inch apart). 

For purposes of analysis, the Set factor has been identified with the timing 
process, and the Difficulty factor with the movement process. This linkage is not 
really satisfactory, as noted earlier. Each factor seems likely to affect both 
processes as constituted. Nonetheless, let us see what the analysis tells us about 
the data. 



Analysis of Process Independence 

Univariate analyses of variance were carried out on the two measures for 
preliminary statis\ical evaluation; these are presented in Table 1. In Fig. 9 time 
and error scores are shown as a function of Grade. Set. and Difficulty. Grade, 
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TABLE 1 

Analysis of Variance (selected sources) of Llne-Drawing Experinrient*^ 



Source 


Time (sec) 


Errors 








F 




Grade/Age (G) 


^ 5.6* 




13.2* 




Ability iA) 


<1 




'<1 




GX A 


-1 , 




-1 




NfGA) 


-'• 


1743. 




45.9 


Instructional set (/) 

c 










No set versus accurucy + speed {I^ ) 


44.8** 


247.9 


21.5** 


4.7 


Acctiracy vursiK specd f/j ) 


113.2** 


449.5 


47.7** 


9.6 


Difficulty (D) 


188.9** 


416.6 


76.0** 


24.9 


Session (S) 


3.5 


677.5 


<1 


12.6 




20.7** 


108.7 


22.1** 


3.9 




64.0** 


78.7 


39.0** 


5.2 


xS 


1.7 


479.8 


<1 


3.0 


X S 


3.2 


326.3 


<1 


as 


D XS 


3.7 


275.6 


" <1 


9*7 


r; X /, • 


<1 


247.9 


9.1** 


4:7 


(; X 


2.5 


449.5 


9.5** 


9.6 


Ci X D 


<1 


416.6 


13.1** 


24.9 


G xJ^ X D 


2.7 


i 108.7 


8.6** 


3.9 


a X i^x D 


<1 


78.7 


5.9** 


5.2 


Residual 




154.0 




'2.5 



^d} for all tests arc 1 and .^6. 

*/••([, 36, .05) - 4.12. 1. 36. .01) = 7.40. 



the two Set contrasts und Difficulty are all significant sources of variance for 
both measures, as are certain interactions among these factor.*;. Instructions to 
"be more accurate" slow the children down a little, without any noticeable 
decrease in errors. Instructions to "speed up*' are obeyed by the children (and 
happily so), but with a marked increase in errors. Difficulty has a large effect on 
both time and errors. The children take much longer to connect the rabbit and- 
carrot when the lines are close together, but they also make a greater number of 
errors under this condition. The interaction between the Set and Difficulty 
factors can be traced to the speed instructions. The effect of the Difficulty 
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FIG. 9 linie and error scores as a function of Grade, Set, and Difficulty, averaged over 
sessions. E asy items are open circles. Hard items are filled circles. ;V - 20 in each group. 

factor is greater for errors and smaller for response time under speed instructions 
compared to the other two instructional conditions. The kindergartners make 
more errors than first graders, especially, in the difficult condition and under 
instructions stressing speed. 

On the average, then, the students performed the line-drawing task fairly 
efficiently without explicit instructions about how to arrange the trade off 
between speed and accuracy. They worked about as slowly as they felt they 
could, and speeding up led to an increase in errors. 

Certain of the subject-factor variance estirnates are substantially (and signifi- 
cantly) larger than the residual variance based on the highest-order interaction. 
There are large individual differences in the time measure du? to variation in 
accuracy vs. speed and difficulty, as well as variation from the first session to the 
second. Variation in difficulty is the largest source of individual difference in the 
error scores, followed by session and accuracy-speed. 

The process model in Fig. 8 must be rejected on several grounds. Both 
measures arc strongly affected by both lectors, and the interaction between the 
two factors is significant. Tht large subject-factor variance in time due to 
variation in difficulty is also evidence contrary to the model. 

These findings suggest that either (a) the two processes are so complexly 
related that little is gained by postulating separate processes, or (Z?) the factors 
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TABLE 2 



Correlation Matrix of Time and Error Scores, 


Line-Drawing Experiment" 




VARIABLE 


1 


2 


3 


4 


5 


6 


7 


8 


9 


Time avc botli* 


1 


~ — — — ■ 


- — — — 

---^ i 




95 




84 


~ — - 
-20 


54 


68 


75 


Errors ave both 


2 






Z4 


96 




96' 




-33 




Time ave I 


3 


86 


-65 




.;:-23 


61 


-23 


46 


74 


80 


Error ave i 


4 


-SS 


89 


--66 






85 




^ -33 




Time ave U 


5 


82 


-38 


42 


-24^ 






53 


39 


47 


Error ave U 


6 


-52 


83 1 


-45 


• 48 


-42^ 






-31 




TifTip i Mq F« 
i iiiiw I iii> r. 


7 


79 


-69 


82 


'69 


49 


-49 




-^34 


42 


D 


8 


49 


-^56 


72 


-^0 




-36 


65 






Acc ii 


9 


82 


^2 


91 


-43 


45 


-29 


71 


44 


-..^36^ 


D 


10 


88 


-59 


94 


-58 


Si 


-41 


71 


54 




Spd E 


1 1 


34 


-39 


53 


-38 




-29 


26 


34 


34 


D 


12 


56 


--62 


73 


-~63' 




-43 


52 


53 


50 


Error I E 


13 


-22 


42 


-25 ' 


51 






-39 


•-43 




D 


14 


-33 


59 


-37 


77 




21 


-45 


-47 




Acc E 


LS 


. -26 


32 


-20 


49 


-24 




-24 


-20 




I) 


16 


36 


.70 


50 


86 




30 


-43 


^42 


-33 


Spd E 


17 


-44 - 


67 


-38 


62 


36 


52 


-51 


-37 


-22 


D 


18 


-59 


84 


>73 


89 


23 


52 


-73 


-56 


-53 






66 


38 


39 


26 








Time 11 NsT* 


19 


74 


-40 


69 


28 


35 


I) 


20 


74 


-21 


39 




89 




48 




50 


Acc E 


21 


120 








56 


-21 




-21 




D 


22 


74^ 


-41 


41 


28 


87 


-43 


40 


20 , 


40 


Spd E 


23 


20 


-23 






55 


-37 


21 




1)^ 


24 


-65 


- 57 


39 


32 


73 


-71 


34 


23 


28 


Error U Ns E 


25 




35 








60 






I) 


26 


-37 


72 


-34 


42 


-27 


86 


-43 


-29 


-20 


Acc {•: 


27 


-30 


39 


-31 


39 




28 


-35 


-29 




V 


28 


-49 


69 


-30 


36 


-53 


88 


-^3 




-23 


Spd E 


29 


-32 


56 


-35 


41 




57 




-45 


D 


30 


-54 


80 


-79 


'47 


-^2 


95 


-56 


^39 


-35 



^lirst graders above diagonal. I^indergartunurs below diagonaE Eor clarity, decimals 
omitted. r\ above .5 are in Inildface. and r\ below .2 are deleted. Variable name codes arc 
Avc (averai^e), I and 11 (first and second session). Ns (Nd set), Acc (accuracy), Spd (Speed) 
E (Easy), and D (Difficulty). 



are poorly dermcd witii rclerence to the two processes, (which seems probable), 
or (c) the Pleasures are poor indicators of the underlying processes. 

Analysis of Parameter Independence 

We turn next to an examination of intercorrelations among the measures. Typi- 
cally. aA investigator might look at correlational data like that in Table 2, or 
some portion thereof. The 2 X 2 matrix in the upper leftliand corner is a likely 
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TABLE 2 (continued) 
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{continued) 



candidate. It gives the correlation between time and error scores averaged for 
each student over tlie entire repeated-measures design structure. The correlation 
is negative in both groups, negligiblq in the first-grade data but fairly sizable in 
the kindergarten data. It appears that there is a tendency for children to trade 
off speed and accuracy on this task; the faster a child draws, the more likely he 
is to make an error. 

The 4X4 matrix just down the diagonal is another reasonable analysis. It 
shows the relation between time and errors calculated for each student from the 
average conditions in each session. Again there is evidence of an inverse relation 
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TABLE 2 (continued) 
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between time and error saires. Performance is reasonably stable from one 
session to tlie next in first graders, and moderately so in the kindergartners. 

The remainder of the matrix presents the entire repeated-measures design 
stnicttrre, perhaps the most defensible way of presenting the raw data. The 
correlations between time and error measures are blocked in to emphasize a 
particular property of these data. The several time measures tend to be relatively 
highly correlated, as do the error measures, compared to the inter-measure 
a)rreJations- But the patterns are admittedly fuzzy. It is the sort of matrix that 
might be subjected to factor analysis in order to clarify the underiying struc- 
tures, t 

However, raw scores are not the measures to examine, given the theoretical 
point of view elaborated previously. Each raw score is a combination of factor 
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effects (cf. Fig. 5) which may be interrelated in more or less complex fashion. 
Let us see what the relations between the parameters of this data set look like. 

To determine relations among the basic parameters, we will use linear contrasts 
computed from the raw scores for several of the sources from the analysis of 
variance (Table 1). The correlation matrix displayed in Table 3 shows the 
relations between certain contrasts along with two average scores, the average 
over all conditions (Ail) and the average over all No-Set conditions (No Set). 
Each of the entries in this table stands for a parameter from the general linear 
■ factorial hypotl\eses for this experiment. For instance. Time All (Variable 1) is 
the average response time over all the design variations for a given subject. This is " 
equivalent to an estimate of i^time subject n. Time A vs S (Variable 4) is 

the contrast in rime scores between the accuracy and speed condiUons, averaged 
over difficulty and sessions. This is related to .the esUmate of the parameter 
«.i/.v.iimLvi f^^r the subject >2. 

Table 3 was obtainea by compuUng these parameter estimates for each 
subject, and entering these values into ji'standard correlation program. Since a 
great deal of information is compressed in this .table, it may be worthwhile to 
describe its organizaUon in more detail. There was reason to believe that the 
kindergarten and first-gfade data miglit show different patterns, and so separate 
analyses were conductecl at each grade level. Kindergarten results are below and 
to the left of the main diagonal, first-grade above and to the right. Time and I 
error scores are analyzed separately. Along the margins are the residual standard " 
deviaUons for each source (this is the square root of the error mean square from 
tlie analysis of variance calculated Separately for each grade), and the F ratio for ' 
the source (again based on separate analyses for each grade). The major elements ' 
of ail analysis of, variance can be reconstructed from these marginal entries, and 
the relative magiritude of various sources and of error terms can be seen. 

The off-diagonal entries in Table 3 are, as. noted eadier, Pearson correlations 
between the contrast scores. To give a concrete idea jf what the relations in 
Table 3 mean, two scatterpjots are presented in Fig. 10, The kindergarten and 
first-grade data have been combined in these plots. 

The correlarion matrix in Table 3 has a reasonably simpla structure. Certain 
correlarions are very large (positive or negative) and the restlend to be relatively 
small. Except for the No-Set vs. Accuracy-Speed contrast, and the interaction of 
this contrast with DitTiciilty, the correlations within the time and error subma- 
trices are high. With few exceptions, the correlations outside tliese submatrices 
are small. 

■ This pattern, together with an exantiinaUon of the scatterpiots for the larger 
correlations (those in Fig. 10 are typical), shows that children who either work 
fast or make lots of errors are relatively unaffected by variaUon in the situaUonal 
factors. Set and Difficulty. Moreover, stydents who are strongly affected by 
variaUon in one situational factor (Set), are strongly affected by variaUon in the 
other situational factor (Difficwlty). 
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FIG. 10 Suiiiplt; scatterplots for contrast estimates, line-drawing study, 

A particularly interesting feature t)f these data is that the statements above 
apply uulependentlv td the two response measures. The eorrelation between 
lime and error contrast scores is negligible, with a few exceptions to be discussed 
below. This result suggests that the process model in Fig. 9 might be reasonably 
adetpiate after all. The Set and Difficulty factors do not fulfill the requirements 
tor testing an uulependent-process model they were not selected to link 
uniquely to the proposed operations but the nn)del may be a useful approxima- 
tion. 

In any event, the purpose of this exercise is not to promote any substantive; 
finding. It does seem noteworthy that the approach leads to a considerable 
simplification in the data on its maiden, voyage. The data in Table 3 scarcely 
require further clarification. The basic structure is immediately apparent: time 
and error comprise two independent components, the constituent parameters of 
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which are highly interrelated. It is obvious when a constituent drops out. For 
instance, the No-Set vs. Accuracy-Speed contrast in time scores is a substantial 
and significant source of variance, but unrelated to any other contrast. This 
contrast was chosen as the orthogonal complement to the Accuracy vs. Speed 
contrast, but it may not make psychological sense. One possibility is that the 
No-Set scores might serve better as a covariate: However, as can be seen in Table 
3, these scores are highly correlated with the overall average, and the pattern of 
contrast relations with No-Set and All scores are practically identical. The matter 
remains unresolved at this point in the analysis. 

The kindergarten sample also exhibits a noticeable departure from time-error 
independence. Average time is inversely correlated with average error (this was 
observed in Table 2), as well as with several error contrasts. The Easy vs. 
DiHlcult contrast for time measures is also correlated with the error ratp. In the 
younger children, movement accuracy is more or less controlled depending on 
instructional set and difficulty. In the older children, the two systems are totally 
independent. This statement is more precise and informative than the conclusion 
from Table 2 that time and error scores were inversely correlated. 

Analysis of the Llne-Drawing Study; An Overview 

Several features of the data are brought into focus by the variance-covarlance 
analysis of specific linear contrasts that would be obscured in more conventional 
analyses. Let us review briefly the main implications of this analysis: 

1. Process independence, based on the relations predicted in Fig. 8 for average 
factor effects, must be rejected. Factors linked to one' process affect 
measures linked to cither processes directly and through interaction. 

2. Process independence, looking at subject-source interactions, is irrelevant 
given the preceding result. But subject-source interactions are large enough 
in at Iciftt one instance to suggest that independence can also be rejected by 
this test. 

3. Intraprocess parameter independence is not testable in .this design. 

4. Interprocess parameter independence is supported by the low correlations 
between time and error contrasts. This suggests that time and errors tap 
separate processes whicii the design factors may be affecting in confounded 
fashion. Speed and accuracy are inOuenced in varying degrees from one 
student to another by variation in situational factors. 

5. (General parameter indeppndence holds for the first-grade sample, but not 
the kindergarten sample. 

6. General'-specific parameter independence can be rejected in almost every 
instance. Average time and error scores are^higJily correlated with respon- 
siveness to situational factors. , 
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IMPLICATIONS FOR 
EDUCATIONAL TEST PROCEDURES 



Current test construction proceeds ;is i( tvo place buckets under psychological 
processes and collect the output more or less directly froni individual subtest 
measures (usually total correct responses). Control over variation in the input is 
modest at best, and nonexistent in most mstances. This simple model has been 
extended by such methods as factor analysis, but it seems to have some inherent 
weaknesses, it does not jirovide a natural way for introducing process-oriented 
variables and contextual variables into the testing situation in an easy-to-measure 
fashion. 

Factorial test designs seem to provide a simple but informative way to build a 
tost around a process model. This approach is similar in spirit to the notion of 
lacet tests discil^sed by Guttman (I%5: Guttmau & Schlesinger, 1967). Careful 
analvsis o\ a task may turn up many • factors of poteritial importance, but 
tractijinal laciorial designs allow optimal arrangement of a factorial test struc- 
ture that I maxirmmi amount of relevant information is obtained for a given 
number of test items (Kirk, l^HiH, Chapters The expermiental control 

obtamed iir such designs provides great sensitivity with a reasonable constraint 
on test length, 

Linea'' contrasts have come into comrTion use in the experimental psycho- 
logical literature, especially in the analysis of repeated-measures designs. Their 
use in test analysis as an alternative to subtest or factor scores holds considerable 
promise. To ho sure, there are unsolved problems connected with item analysis 
and test reliability. 



'.nt;nitivr p^ycho^)gy in providin^T a better understanding of instructional pro- 
cesses. Ihe preceding remarks on test procedures are directed toward educators.' 
liut for those readers wlu^se interests are more directly related to cognitive 
psydu^logv, f should point out again that the analysis^ of contrast scores has 
diroi.1 implkalions tor tests of information-proeessing models. Since Sternberg's 
(l'H>')) landmark i)aper on the use of factorial designs in evaluation of indepen- 
dent cognitive j)rocess nu^dols, repeated-measures designs have jilaycd a central 
role in research on ctigrutioiK The analysis of the Variance-covnrianee structure 
of a sot ot kdiitiasts dostrihed here is not covered by the standard methods of 
analvsis now m u^o. Ihoso are now tochmcjues. They ask new questions of data, 
{]uostn)ns which are critical to an understanding of individual differences in 
thouglit and action. 



ADDENDUM 



This V(^lume has directed its attention to educational matters, and to the role of 
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This chapter takes us its general theme the actual and potential role of task 
analysis, particularly information-processing analysis, in instructional theory and 
instructional design. Some definitions are needed to make this openingstatement 
'* sensible. The term 'Instruction" is used here in its most general sense to refer to 
any set of environmental conditions that are deliberately arranged to foster 
increases in competence. Instruction thus includes demonstrating, telling, and 
explaining, but it equally includes physical arrangements, structure of presented 
material, sequences of task demands, and responses to the learner's actions. A 
^theory of instruction, therefore, must concern itself with the relationship be- 
tween any modifications in the learning environment and resultant changes in 
competeifce. Wlien the competence with which we are concerned is intellectual, 
development of a theory of instruction requires a means of describing states of 
intellectual competence, and ultimately of relating changes in these states to 
manipulations of the learning environment. 

\\\ developing n theixr>' of instruction for intellectual or cognitive domains, task 
analysis plays a central role. I mean by task analysis the study of complex 
performances so as to reveal the psychological processes involved. These analyses 
translate "subject-matter" descriptions into psychological descriptions of behav- 
ior. They provide psychologically rich descriptions of intellectual competence 
and are' thus a critical step in bringing the constructs of psychology to bear on 
instructional design. 

Psychologica} analysis of complex tasks is not a totally new idea. Task analyses 
are performed, although not usually under that name', in virtually all psychologi- 
cal investigations of cognitive activity. Whenever performances are analyzed into 
- components for experimental, interpretive, or theoretical purposes-task anal- 
. ysis of some kind is involved. Although the study of complex cognitive tasks has 
never dominated empirical psychology, there have been significant occasions on 
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which prsyclu)U)gists have turned their attention to siicli tasks. Not all have been 
instructional in intent, but several important attempts bear exifmination because 
they have suhstarUially intluenced m^^tructional theurv or practice, or because, 
considered with instructional questions in mind, they olYer insight into the 
possible nature ol a theory of instruction based on ctignitive psycluilogy. 

Because task analysis is pervasive in psychological research, it i,s important to 
consider what kinds oi' analyses are particularly useful in instructional design. 
Several crueria can be used \o evaluate the potential contribution to in,struction 
of ditlcrent approaches to the psychological analysis t)f tasks. Four such criteria 
•seem particularly important: 

Instructional relevance Are the tasks analyzed ones we want to teach? That 
is, are the t^tsks studied because of their instructit)nal ox general social relevance, 
rather than because they are easy to study, have a history of pust research that 
makes results eas\ to interpret, tir are especially suited to elucidating a point of 
theory'* Iho criterion of instructional relevance implies that most tasks analyzed 
will be complex lelative to many tjf the laboratory tasks that experimental 
psychologists tmd uselul when. pursuing noninstructional (piestions. 

Psychological formulation Does the analysis yield descriptions of the task in 
terms of processes or basic units recognized by the psychological research 
coinnuinity? Task analysis is a means of bnnging ctnnplex tasks, which have 
generally resi,sted p^o{\ experimental analysis, into contact with the concepts, 
-inethods, and theories t)f psychology. Thus, while the starting point for instruc- 
tional task analysis is prescribed by social decisions -what is important to 
teach the outcomes of such analysis, the terms used in breaking apart complex 
pertorniances, must he determined by the state of theory and knowledge in 
psvchology. 

It is not always easy to fulfill both the instructional relevance and the 
psych(.)logical formulation criteria at once; instructional relevance is defined in 
different lerms than those which psychological researchers use in building their 
tliet)ries. Nevertheless, it is lni[U)rtaiit to try to analyze instructional tasks in 
terms that make contact with the current body of knowledge and constructs in 
psychology so that instructional practice can protit from scientiiic findings as 
thev exist and as they develop. 

If)stru{ tahflity Because mn ciJUcem heie is with task analysis as an aid to 
instruction, an o()vious questjoii rs whether the results of a paMicular analysis are 
iL^:eable in instructional practice. In other words, does the :ask analysis reveal 
elements of the that lend themselves to instruction, i.e , that are "instruct- 
able *'* It r^ the tunction task analysis to examine comple c performances and 
display m them a substructure lhat is teachable either thn ugh direct instruc- 
tit)n in the uivmponents, or by practice in tasks that call upon the same or related 
processes. 
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Recognition of stages of competence Dt^o.s tlie tnsk analysis recognize a 
distinction between early forms of competence and later ones? Analyses for 
instructional purposes cannot iiist tlescril'i^o the expert'«5 performance (althougli 
such description will almost always be a part of such analyses). They must also 
describe performance characteristics of novices and attempt to discover or point 
to key differences between novices and experts, suggesting thereby ways of arrang- 
ing experiences that will hel[) novices l)econie experts. Instructional task analysis, 
in other words; should elucidate the relations between activity c/i/ra^learningand 
competence that results fnnn learning. It should suggest ways of organizing 
knowledge to assist m acquisition, recogni/ing that this organization may differ 
from orgaiuzations that aio most efficient for expert use of that knowledge. 

In summary, four criteria can be applied in assessing Uie contributions of 
psychological task an'alyses to instruction: ( 1 ) instructional relevance; (2) psy- 
chiilogical foinuilatiDiK (.^) instructability: and (4) recognition of stages of 
competence In the course of this chapter, I shall examine several prominent 
approaches to the psyclioh)gical analysis of complex tasks and consider their 
contributions to in^trm-tion in light of these criteria, I begin with some impor- 
tant past efforts io doseribe intellectual competence in psychological terms, and 
then turn to current miiumatiini-processing approaches to task analysis. In order 
to make the domain of the chapter manageable, discussion is limited to analysis 
of mathematics tasks. The work discussed, however, is not intended to be 
exhaustive of task analysis efforts in mathematics. Rather, it is intended to 
highlight certain cases that have considerably innuenced psycholt)gy or instruc- 
tion, or botli, and that torm landmarks in whatever might today be written of a 
liistoiv and cuireni status report on this branch of instructional psychology. 

ASELECTIVE HISTORY OF TASK ANALYSIS 

i will discuss first the work of three predecessors of modern information 
pri>cessint» task analysis, m each case using work on mathematics as the substan- 
tive example. Iheso aav ia) work in the associationist/behaviorist tradition 
(Thonidike, Gagne); (/O work of the Gestalt school (especially Max Wertheimer); 
and ic) tfie Piauetian task analyses. Both substantively and methodologically, the 
ap[)roaclios of these groups tu task analysis reilect differences in thejr theoretical 
positions, diftctences whh.h in tuin i\\kct the kinds of contributions that each 
can make to instruction. 

Tho As'iocjarioni<;t/Behcivu)rist Tradition 

Thorndiko's analyses in terms ofS R bonds In the early part tiT this century, . 
experimental and educational psychoh^gv' were closely allied. Many of the major 
psychologists of the period up to about I^).^0 were actively engaged in both. 
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laboratory research and applied research, some of it relevant to instructional 
practice. One of the foremost of these was Edward L. Thorndike. His work on 
The Psychtilfitry of Arithmetic, published in 1^)22, represents his attempt to 
translate the associalionist theory of "laws of effect," which he himself was 
active in developing, into a set of prescriptions for teaching arithmetic. In the 
preface to the book, Thorndike states (M)22) that there is now a **new point of 
view concerning the general process of learning. We now understand that 
learning is essentially the formation of connections or bonds between situations 
and icspt)nses, that the satisfy ingness of the result is the force that forms them, 
and that habit rules in the realmOf thought as truly and as fully as in the realm 
t)f action [p. v|/' Based on this then widely agreed upon theory of psychological 
functioning, Thorndike proposed a pedagogy that has extensively influenced 

' educational practice for many years. 

Hiorndike proposed the analysis of arithmetic tasks in terms of specific 
connections, or bonds, between sets of stimuli and responses, and the organiza- 
tion of instruction to maxuTiize learning of- both the individual bonds and the 
relations among them. His book began with a discussion of the general domains 
of arithmetic for which bonds must be formed -for example, the meanings of 
niimbers, the nature of decimal notation, the ability to add, subtract, multiply, 
and divide, the ability to apply various concepts and operations in solving 
problems. Thorndike then spent some fifty pages discussing the types of bonds 
that give precise meaning to this broad definition of the domain of arithmetic. 
His analysis did not approach the level of individual stimulus-response pairs but 
remained on the more general level c)f connections bety/een situations and sets of 
responses. Citmg numerous examples, he argued that c<irtain kinds of bonds 
taught in many of the standard textbooks of the day were misleading and should 
not be taught, while other helpful bonds were neglected in pedagogical practice. 
Fnjr example, verifying results of*computations, learning addition and substrac- 
tion facts for fractions, and solving problems in equation form (even before 
algebra was added to the curriculum) were considered *'desirabkV' bonds, where- 
as senseless drill in llnding the K)vvest conunon denominator of fractions (when 
iLse of any common denominator would lead to solution of problems) and the 
posing of problems unrelated to real-life ,situations led to the formation of 
''wiistetul and hamiful" bonds that made arithmetic confusing and unpleasant. 
Discussion of a[)propriale and inappropriate forms of measurement of the bonds 
or elements oj" arithmetic knowledge were also included. Thus, the total c[\cci of 
the book was to suggest the tronslation of a standard school subject into 

« terms collections of bonds that suggested applications of known laws of learn- 
ing to the problems of.instruction. 

The laws of learning, and thus of pedagogy, were for Thorndike tho,se dealing 
with such drill and practice as would strengthen the bonds. Questions such as 
amount o( practice, under- and overlearning, and distribution of practice were 
considered. These are easily recogm/ed as topics that have continued to occupy 
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psychologists -although rarely directly in the context of school instruction -and 
that heavily though indirectly influence instructional practice. What is important 
about Thornd.ike's work, however, is that he developed a concern not only with 
tlie laws of learning in general, but also with the laws of learning as applied to a 
particular discipline, arithmetic. He left the laboratory to engage in applied 
research, but brought with him the theory, and to a large extent the methodol- 
ogy, of the experimental laboratory. He thus began a tradition of experimental 
work in instruction by psychologists. This tradition was interrupted for many 
years but is now being revived, as the chapters ui this volume bear witness. 

Gagne's hierarchies of learning sets While Thomdike recognized the need for 
a theory of sequencing in his presentation of bonds identified as constituting the 
subject Hiatter of arithmetic, he had no systematic theory of sequencing to 
propose. In the decades following Thomdike's work, mathematics educators and 
educational psychologists (e.g., Brownell & Stretch, 1931 ; Hydle & Clapp, 1927) 
studied, with varying degrees of care and precision, the relative difficulty of 
different kinds of mathematical problems. They thus empirically, if not theoret- 
ically, extended Thorndike's work in instructional analysis. The suggestion 
underlying this later work was that arranging tasks according to their order of 
difficulty would optimize learning, especially of the more difficult tasks. Skin- 
ner's (1953) prescription for the use of ^'successive approximations" in instruc- 
tion represented a refinement of this basic idea. However, neither Skinner nor 
his immediate interpreters proposed, a systematic strategy for generating the 
order of successive approximations-i.e., the sequence of tasks in instruction. It 
was not until the 1960s, and Gagne's work on hierarchies of learning (Gagne, 
1%2, 1968), that any organized theory of sequencing for instructional purposes 
appeared within the behaviorist tradition. 

Learning hierarchies are nested sets of tasks in which positive transfer from 
simpler to more complex tasks is expected. The "simpler'' tasks in a hierarchy 
are not just easier to learn than the mbre complex; they are included in- 
components of the more complex ones. Acquisition of a complex capability, 
then, is a matter t)f cumulation of .Capabilities througli successive levels of 
complexity. Transfer occurs becaus^ of the inclusion of simpler tasks in the 
more complex. Thus, learning hiera/chies embody a special version of a **com- 
mon elements" theory of transfer. / 

Hierarchy analysis has come mjo rather widespread use among instructional 
designers, particularly in the fields of mathematics and science (see White, 
1973). For the most part, the analyses have been of the kind Gagne originally 
described. Thus, hierarchies for instruction are typically generated by answering, 
for any particular task under consideration, the question: "What kind of capa- 
bility would an individual have to po.ssess to be able to perform this task 
successfully, were we to give him or her only instructions?" One or more 
subordinate tasks are specified in response to this question, &nd the question is 
applied in turn to the subordinate tasks themselves. 
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llki 



^TASK 1 



Statrng. usinq spectfic numbers, 
the serfes of steps necess.iry to 
forrnuidty i cieftnitjon of <Jddit»on 
of inteners, using whatever 
properties are needed, assuming 
those not previously t'stabhshed 



Supplying] the steps and 
uientifyinq the properties 
tissurned m asiertinq the 
truth of statements involv 
inq the addition of integers 



I la 



.Suf)plyinn other names 
for positive infeqer*; tn 
statffriients of erju ihty 



Statinq aruj usinq tht? 
(JeftrntHun nf atldrtion 
of ari iritet]*?r aruJ its 
atlditivf? invMTst? 



IVa 



IVh 



numbf?t {) as tho 
addjtivt? tfientiry 



TASK 7 



AdtJinq integers 



lb 



Stating and using the 
definition of the sum 
of two integers, if at 
least one addend is a 
neqative integer . 



lib 



Identifying and using the 
properties that must be 
<issumeci in asserting the 
truth of statements of 
e(UJ«ility in addition of ' 
integers 



lllb 



Statmg and using the 
(JefinKion of addition of 
two positive integers 



IVc 



IJupplyiru} (Uht?r 
niirnnrali for wholf? 
numbers, using the 
assochHive property 



Va 



IVd 



!jupplyint] Dtlier 
numerals for whole 
numbers, using the 
commutative property 



kJentifying numerals 
for whole numbers, 
employing the closure 
property 



Vb 



Performmg atidition 
anr} subtraction of 
whole nurnbf?rs 



Using parentheses to 
group names for the 
same whole number 



FIG. 1 \ learning hierarchy pertaining to the addition ot integers. (Prom "Factors in 
acquinng knowledue of a mathematical tusk'' by R. (;agnt;. J. R. Mayor. II, L. Garstens, 
& N. h.. Pimidisii. Pu chol()gh'al Afonof^raphs. 1962. 76 ( Whole No.' 526). C\)pyright 1962 by 
the American Psychol o^^ical- A ssoci^^ lion. Reprinted by permission.) 
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Figure 1 shows an example of one of Gagne's hierarchies. The tasks described 
ill the top-level box are the targets for instruction. Lower levels show successive 
layers of subi)rdinate capabilities, that is. simpler tasks whose mastery would 
facilitate learning the more complex ones. Instruction would begin with the 
lowest-level capabilities not already mastered and proceed upward. The tasks at 
the low end of the hierarchy can be analyzed further, depending on assumptions 
about the learner's knowledge. It is assumed that the more elementary capabil- 
ities are learned through more elementary types of learning. In other words, 
implicit in a complete learning hierarchy for a task such as the one shown in Fig. 
1 is another hierarchy of "types of learning." progressing from simple S-R 
learning, througli chaining and discrimination, to higher-level concept and rule 
learning, as shown in Fig, 2. A more complex task such as problem solving would 

I 
I 

I ' .. 

I 

I ■ 
I 




1 




FIG. 2 (lasjiieX luerarvhy ot npcs ot ItMriuiii;. U ri>ni R. M. (I.ignc, Ilic Conditions of 
Uarmni: (2rul od ). NV\v Holt. RinclDrl kK. Winston. PHD. C()pyni::ht l%5 by HdU. 

RimMi.irt & Wirjstun. Reprinteil b\ pcrnnssi«>n ) 
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involve more concept and rule learning and would lead to the discovery of 
progressively higher-order genernlizable rules. 

(iagne's hierarchy analyses appear to flirt with information-processing concep- 
. tions of psychology, but. not to come to grips with them. There is a kind of 
implicit process analysis involved in the method of hierarchy generation. Presum- 
ably, in order to answer the question that generates subordinate tasks, one must 
have in mind some idea pf what kinds of operations mental or otherwise- an 
individual engages in when lie or she performs the complex task. However, this 
model of perfornrance is left entirely implicit in Gagne's work. 

Gestalt Psycholoyy and the Analysis of Mathematical Tasks 

Gestalt psychology was an immigrant in America, hi its first generation it spoke 
a language so unlike the rest of American psychology that it was barely listened 
to. Now, in a period when we speak easily of cognition and mental operations, - 
the gestalt formulations take on more interest for us. Gestalt theory was 
fundamentally concerned with perception and particularly the apprehension of 
'\tructure/' With respect to the complex processes involved in thinking, the 
concept of structure led io a conir.n with ''understanding'' or 'Mnsight/' often 
accompanied by a visual representation of some kind. Witli respect to problem 
solving, the central concern was with the dynamics of '^productive thinking.'' 
Several gestalt psychologists, particularly Wertheimer "(1959) and his stUdents 
(Katona, 1940: Luchins & Luchins, 1^^70), attempted to apply the basic princi- 
ples of ge,stalt interpretation to problems of instruction and, in particular, to the 
teaching of mathematics. It- is reasonable to imagine that mathematics, especially 
geometry, was of particular interest Jo gestalt theorists because of its higli degree 
of internal structure and ifs susceptibility to visual representation. 

Wertheimer contrasted his theory of productive thinking both with traditional 
logic and with associationist descnptions of problem solving. Neither of these, he 
claimed, gives a complete picture of how fww knowledge is produced by the 
individual With respect to teaching, he was concerned that prevalent methods of 
teaching, with emphasis on practice and recall, produced "senseless combina- 
tions" rather than prtiductive problem solving based oil the structure of the 
problem, 

WertheimerN (1^)50) book, ffodurthv Vmking. originally published in 1945, 
discusses work on several mathematics problems for example, finding the area 
of a parallelogram, proving the equality of angles. Gauss's formula for the sum of 
a . series, symmetry of oscillations, arithmetic calculations, and the sum of angles 
of a figure. Analysis of these tasks, for Wertheimer, ct)nsisted of displaying the 
problem structure on which algorithms are ha,sed, rather than analyzing actual 
performance. Thus, for example, the problem of finding the area of a parallelo- 
^gram was seen as a problem of '*gap fitting" too much on one side, too little on 
the other (see Fig. }). Once the gap is filled and a rectangle fonned, a general 
principle for finding area can he applied. It is recognition of the nature of the 
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FIG. 3 \Verliicinn:r's area i)!' a parallelogram problem. 

problem the possibility of transforming the parallelogram into a rec tangle-that 
constitutes lor Wertheimcr ''understanding" or "insight/' Solutions that follow 
from this understanding are for him true solutions, elegant ones. Those that 
""bUndly'' apply an algorithm, even if the algorithm should work, are "'ugly'' 
(Grceno, Chapter 7 of this volume, discusses another example from Wertheimer). 

though Wertheimer talked little about general schemes for' instruction, his 
notions imply the necessity of analyzing tasks into components, perceptual and 
stTUctural, such that their nature in relation to the whole problem is clear. Only 
when the true structures of problems are understood can principles derived from 
them be properly generalized. Wlienever possible, it should be left to the student 
to discover both the problem and its sohition. Instruction, if it should be 
necessary, should proceed in a way consistent with the internal structure of the 
problem, and in the proper sequence, u) that a true understanding is gained by 
the child, leading to solution. Just hew the understanding of components and 
their part-whole relationships is to be taugiit is not made clear. Wertheimer 
suggested that exercises could he introduced which focus Students' attention on 
certain aspects of the problem structure, which should increase the Jikelihood of 
achieving insight. He also spoke of certain operations involved in thinking 
processes grouping, reorganizing, structuri/ation from which one might devise 
ways of teaching., | 

/ 

Piaqetian Analysos 

in discussmg Piagetian task analysis we must consider two quite distinct bodies 
of literature: (l)"Piaget\ own wotk (and that of others in Geneva); and (2) 
•attempts largely by American and British psychologists-to isolate the specific 
•concepts and processes luulerlving performance on Piagetian tasks. I will discuss 
these in successu)n. 

Genevan work Much of Piaget's own work (on number, geometry, space, etc.) 
is heavily mathematical in orientation. It seeks to characterize cognitive develop- 
ment m terms of a sniccession of logical structures commanded by individuals 
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over time, the "cliiiica! method'^ used by Piuget in his research yields great 
quantities of raw process data-protocols of children's responses to various tasks 
and questions. The protocols are interpreted in terms of the child's *^having'' or 
*"'not having* structures' of different kinds. Explanation of a task performance 
for Piaget consists of descriptions of the logical structu-res that underly it, and of 
the structures that ontologieally preceded and therefore in a sense "gave birth 
to'' th$ current ones. 

Piagct's tiisks are chosen to exemplify logical strucUires that are assumed to be 
universal. xMany of them tuni out to involve mathematics, but by and hirge not 
the mathematics th^t is taugfit iji school. One result has beeSh considerable 
debate over whether the Piagetian tasks should become the basis of the school 
curriculum, whether they are tenchable at all, and whether they set limits on 
what other mathematical content can be tauglU (for differing points of vie.w on 
this matter, see f'urth, 1970; Kiimii, 1972; Kohlbcrg, 1968; Rohwer, 1971). 
Although until recently Piaget's work has not been motivated by instructional 
concerns, other , have tried to interpret his work for instruction. This has often 
rei>ultcd in at least partially compe-ting interpretations. 

Piaget's most important contribution to task analysis is probably his pointing 
out, in compelling fashion, that there are important differences between children 
and adults in the way they approach certain tasks; the knowledge they bring to 
them, and the processes they have available. However, his analysis in terms of 
logic leaves questionable the extent to which his descriptions elucidate the 
•>n'c7zf)logics'' of behavior on these tasks, that is, what people actually do. It is 
certahily the'case that for psychologists accustomed to the explicit detail of 
information-processing analyses, the leap "from observation to references con- 
cerning logical structure is often difficult to follow in Pi'aget's work. 

Experimental analyses of Piagefs tasks. Much of the English -language research 
literature on Piaget has focused on locating specific concepts or component 
processes underlying the ability to perform well on particular tasks. Conserva- 
tion tasks have been mostly heavily studied, classification tasks probably next ' 
mogi heavily. There has been relatively little study of tasks characteristic of the 
stage-of formal rather than concrete operational thinking (see Glaser & Resnick, 
1972). 

Two basic strategies can be distinguished in this research. One is tp vary the 
task in small ways to allow inferences about the kinds of cognitive processes 
being used. An example of this tlrst^*stra.teg;f is a series of studies by Smedslund 
(1964, l-967a, b), in which he presetited double classification tasks with attri- 
butes covered or uncovered, labeled or visually presented." From performance on 
these vanatfons, he concluded that processing was probably done at a symbolic 
rather than a perceptual level, that memciry was involved, and that some kind of 
analytic mechanism might be mvolved in committing perceptions or symbols to 
memory. 
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Ihi* v.Vi'iul stratoiny is iiHtiUt^t childa*n in a ci>iKept or process 

J othf u/cd uiidorK perh»rnianLe on some Piagetian task, and tliLMi test to 
A'l* vJi'v"t!u*r t\\v\ thoiehv anpiiro the ability to pertnrni the task. l:xaniples of 
leu' U !i ih ' ^^:^nu\ kind aio (jehiuur> ( i'^<>^M study on training coiiservalioii 
in hi'»i» tli'tiininuHion »>t Kmi^uIi densUy. and number; and Bearison\s 
n*^<>*M studv utdih ui^' toHservahDii by traninn^ in equal-uiiil nieusutonient of 
lupud tpunts?\ ()t fhe Iwd ai^pmaclies, the second is ninre direedy interejitihi; in 
the pr *i'.*ur c»«rito\t. heC;fUse the strategy ot instruction demands an analysis in 
leriiii »»t uf /rtK taM * i.cMnpoiuMits 

Av.evifTVMir of th^ Appruachtfs wjth R^'ftTrni^ to Instruction 

UtiW these pa>l approaches to task analysis luatcli the criteria outlined lor 
in.tit: 'innal u-lev.iiiie^ To wlial extent does each address itself to tasks of 
in.trn* Uitnal w!fcf^'4 ' In what extent do llie terms i)f analysis provide a link to 
llv ninti h\it\\ I.? p:.'>\ h>»loiMcal theory and knowledge? Are instructable Units 
identiHcci.* I)n lb > fitalv n*h di^tnunnsh usefully between performance of learners 
and ft fxperh * 

ln\tnt( tforhil rt'h*\/.in( ^}, Wiih rv .jKV t to ilu* rhuice of tasks, only Thorndike 
and ( j.teTie -Jiovv a clear uistrut tional orienlulion. Their lasks are drawn from 
ichoMi uurricula. and whcr*/ iormal validation studies of their analyses occur, 
fliev are to a large extent based on the effectiveness of actual instruction in the 
unit , uieiUitiod te.tJ . (kigne, Mavor, (larstens, & Paradise, H>62). Wertheimer 
and the otliers of the C^iestalt s hool analyze a few tasks drawn from matlie- 
niatu but make uo attempt U\ analy/e a whole range of subject matter. 
Tuffli'-'r despite Mnn.- distussion of {)rodiictive thinking as a generalized phe- 
nomenon t'diK:atit>nal concern, there is no analysis of it as such in Wert- 
henncr\ work, it seems likely that Wertheimer chose tasks from mathematics 
that wuuhl best lend themselves to analysis in terms of perceptual ''Gestalten'' 
r.i^her tlian seltN ting those of particular importance to instruction. On the 
. rUeriMti ot tvpes tasks analyzed, Piaget's work is even less directly relevant to 
m ,tf I. t'oii . Iher • is, in fiLt. scinnis ijiu'stion vvhetlier the concrete operati(Mis 
tasks lie Htudied '^iiizht t>)bc the objectst^f instruction, since they are psychological 
"in.h at.»is" ot :^'neral c'^i^nilivc status rather than socially important tasks, and 
an. f Eu» v i\\\ vM , .It I.\i-.t \n Western and certain urbanized cultures, to be acquired 
v.itiu«iit rninutl vb^'ohni' \n the coifrse orjeveloptiient ((ilaser & Resnick, 1^>72). 
It ni.iv be. how,'\er> rh.it tormal operations need to be taught explicitly, since it is 
hv fi*« HkMiis ciiMi that touna! operati(Mial thinking is universally accjiiired^ 
|\.-nrf irk. {^^''M. 

f\y f holoqitiil fnrnujhition 1 a. h if^pioach addresses well the analysis of com- 
plex ta:>ks m terms tit die fiaidamental psychologkal constructs relevant to their 
own times and theories. Tims, Tln^rndike's analyses describe aritlimetic in 
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terms of the biisic psycholt)gk.il Ufiii ut ihLMhcurreni theory, ihc associationist 
boiid. and thiN suggest specific pedagogical practices drawn from known princi- 
ples of learnnig. (iagne^ analyses interpret instructional tasks in the terms of 
behavioral IcaVnuig pwcliology; transicr, genorali/alh»n. and so forth. His con- 
cern for the tearnnig of 'liiglior processes'' snch as rules and principles suggests 
si>nie sharing of concern with cognitive psychology: however, hasicrr^gnitive 
processes, such as memory aifd perception, are alluded to only as general abilities 
assumed to be mstructahle or^Yuplher analy/able. Wertheimer's analyses of 
nuithoinafical tasks explkitiy indicate how gestalt field theory would interpret 
problem solving and learnm^ in these ilonunns. F-inally, Piaget's analyses, 
like Wertheimer\, attempt to show that' performance on complex tasks can be 
mterpreted in terms of underlymg structures. For Piaget and Wertlieinier, exph- 
Lation i)f the structures constitutes psyL\hological e^xplanation of the perfor- 
maru e. Bn(h are concerned with charactcfi/ing the broad outlines of cognitive 
structnrt'i rather than with detailing the processes involved in building or 
utih/mg thc^e structures. Only in the experimental analyses of Piagerian tasks do 
wc begin lo \uv\ aiiempls to mterpret performance more explicitly, that is, in 
nittitmafion-pi"COsMn;Mt'*rms. 

tnstrintiihihty. Wfrh lespcct rn the criteruui of instrnctahility, Tliorndike 
and (iagne are diiectly on taruet. Their ami in task analysis is to facilitate 
instruction, and the bonds or subordinate capabilities identified are quite clearly 
described as instructable componenls. Wertheinier is more difficult to assess with 
respec? to this criterion, fhs analyses are specific to particular tasks. They dt) 
di^pia\ the bask structure ol each task and therefore suggest quite directly ways 
<>t teaching that are hkeiv' tn produce maximum understanding, transfer, and 
elegance of solution: hut there are no general units identified which would be 
usciul across a number of tasks. Piaget\ own analyses involve no identification 
of instructable units. However, a review of studies involving instruction in 
Piaitetian tasks ((Jlaser Rcsmck. V)12) sug^'csts that Piagetian concepts are 
mdf.vd Mistru* tahir, ox at Icvist Irnd tluMiiselves to analvsis into certain prerequi- 
site' ,^kdU whit h niav be ms|,nu, table The studies also suggest how delicate the 
process ta->k aiiaUsis and instruction is lor tasks ol any psychological com- 
plexity. It IS necessarv botli to ^dentijy the appropriate iiiulerlying processes or 
ruiuepts and to fintl cftt\ tive ways of teaching tlieni. Ideiitifyhig one underfying 
■ «»n_e:pt will l iirht sulfh tor lull success m instructional efforts because there 
ina\ several abilities which must be combined, and the absence of any one 
may lead it) failure to learn the target task. I iirtlier, "instruction" itself is a very 
dehwiie matter There are no ample rules lor constructing situations that will 
t.nnvev the ^MnveptA ni pr(itc,,es to W tau^lif in a . vlear way. Fveii with an 
:ipf>ropriale task analvsr>. ihe niapfMiii' Irom ulentilied o^MUpoiients to instnic- 
tnmal stratej,nes remains very much a matter ot artful development, 

Rprnqthtfon of sUiqns /)f t nmpetenre. l inally, we turn t(^ tlie novice expert 
di'tin.. tion the cn(eru>n ol ret i>».'m(ion ol staiies of coinpeteiii^e. On tliis matter 
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Thomdike is not ver>- explicit. He recognizes a need for sequencing instruction 
scientificully, but utTers no psychological theory as to how to proceed. Indeed, 
the impression left is that the difference between novices and experts lies solely 
in hi)w many bonds have been learned and how well-practiced these are. That 
there may be important differences in the organization of knowledge -for novices 
and experts is at best only hinted* and not seriously explored. Gagne's particular 
contribution within the behavioral perspective is a practical method for generat- 
ing sequences of instructable tasks., In liis general notion of transfer-inclusion of 
simple tasks in more complex ones— Gagne offers a strong suggestion for how to 
organize instruction for purposes of acquiring higher-orier knowieu^^e and skills. 
Thus, at a certain level, the criterion of recognizing and dealing wi+\ differences 
between novices and experts is explicitly met in learning-hierarchy analyses. 
Wertheimer's analyses, by contrast, attend not at all to the di'"tinction between 
novices and experts. The implicit assumption i^^-lhaJLbehayjDr 4n accord with 
good structural ^^principles is ^'native" and has simply been^'slamped out or 
sq lelched by the drill orientation of schools. 

Piaget, of course, is particularly attuned to changes in the structures available 
to people at different stages in their intellectual development. In fact, with 
respect to instuiction, Piaget's largest contribution is very possibly the highlight- 
ing of substantive changes in competence which occur in the course of develop- 
ment. Piaget\s work makes it impossible to ignore differences between perfor- 
mance strategies of novices and experts whether or not we find Piaget's own 
analyses convincing or accept his explanations of how these changes occur. By 
Lontrast, the experimental or neo-Piagetian work is uneven on this criterion. For 
the most part, these studies investigate single tasks and look for competence 
versus incompetence rather than for stages or transformations of competence. 
There are a few exceptions, largely in recent attempts to interpret changes in 
performance on Piagetian tasks in terms of information-processing constructs 
(see Klahr, in press). Investigators have attempted to analyze sequences of 
Piagetian tasks so thateadding one or two simple processes to an jndividuars 
repertoire, or modifying extant processes, can be shown to account for succes- 
sively more complex performances on the Piagetian tasks. This work takes ''infor- 
mation processing'' as its theoretical orientation and makes heavy use of computer 
.simulation sirategies for fiumal analyses. It thus ft^rms a useful bridge to the second 
part ol this chapter, which is concerned specitically with the present and potential 
role ol intnimation^proccssing task analysis m instructional design . 

INFORMATION PROCESSING ANALYSES 
FOF^ INSTRUCTIONAL PURPOSES 

A major branch of cognitive psychology today carries the label ''information 
pr()cessing." As is often the case with an emerging branch of study, it is easier to 
p(nnt to examples i>f inf{)rination-^)rocessing research than to give a complete or 
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a)iiserisual detiiiition of it. Nevertheless, psychf)liigi: r.s working in this area tend 
to share certain assumptions as well as certain rese*Tch strategies. 

Inforniation-processing studies attempt to aecou U for performance on cogni- 
tive ta^k^ in terms or actions (internal or external) that take place in a temporal- 
ly ordered How, A distinctii>n is generally drawn between data, or m formation, 
and operations on ilata. ot processes. Iluis, the concern ot information-process- 
^gl^sv clTolog\ is with how humans act i^on (priicess) data (information). 
Mequcntly but not universally information-processing models for cognitive 
fihsks arc exprewd as "prrygfdfU<r*^for performaiii^ tasks. These are 

^ofteii formalized as computer programs whose theoretical validity is judged by^ 
their ability ti) simulate actual human perfornKuice. 

Most information-processing theories and models find it useiulJxi-^hnraja ' 
the hunuui mind in terms of the way information is stored, accessed, and 
nperaliul upon. Distinctions are made among different kinds or . 'levels" of 
niemuiy. VVliiUM.htiAlejai ls and the labels v a rv. nio.st theories distinguish between 
a sensory intake register of svmie kind through which information from the 
envirtuimeiu rntcr , ilu- svst«Mii,a working memory (sometimes called short-term 
or internuHliaie-fciin mcninry) in which the actual processing work goes on, and 
a ioni'-torm (semantic) memory m which everything one knows is stored, 
piobalily pormaiicnrK. Within this ueneral structure, working memory is pivotal. 
it IS iinly b> being proccsscil in working memory that material from the external 
environment can enter the iiidividiuiPs long-term store of knowledge, and only 
hy entcruui vvorkin-r memory can intoiniation from the long-term store be 
accessed and used in the course of thinking. Processing in workuig memory is 
usually assumed to be serial one action at a time. F'urther, working memory is 
considered to have a limited number of "slots" that can be filled, so that it is 
only hy rehearsing i)r by **chunkiiig" material into larger units (so that a body of 
mterrtflated information takes up a single slot) that loss of information from 
working memory can be avoided. 

lnlormati(Mi-procossing analyses o[' instructional tasks share these general 
l^^ump!i(Ml^ as well as a body of research* methods that have been developed for 
testing the validity ot models of cognitive perl\)rmaiice. Information-processing 
analyses are clearly distinguished from beliavitirist ones (Tliorndike anU Gagne in 
the present case) by their exphcit attempts to describe bitcnwl processing. They 
dilTer Irorn. the eognitivist (iestalt and Piagetian positions in their attempts to 
describe the tual How perlormajice to translate restructuring*' or "logical 
operations'' into temporally organized sequences of actions. 

hi charav-teri/inv' mformation-processiniZ analyses of complex tasks, it is useful 
to ilistinguish between lational and empirical analy.scs. Rational analy.ses are 
descriptions of "idcili/ed" perromiances that is, performances that succeed in 
responding to task demands, often in highly eHlcient ways, hut not necessarily 
the ways ui which humans actually perform the tasks. Work in artillcial intelli- 
g^Jrice can be considered a form of rational task analysis which is today being 
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applied to iiioroasiiigly complex kinds n|' tasks. So can M)iiie imich less ambitious 
analyses of simple ^asks. some of which are discussed below. Empirical task 
analyses are based on interprctatum of the data (errors, latencies^ self-reports, 
eye or hand movements, etc.) from human performance of a task; the aim of 
such analyses is to develop a description (model) of processes that would 
account for those data, in practice, rational and empirical analyses are rarely 
sharply separated. Rational analyses, lor example, may provide the starting point 
tor empirical data collection, leading to an iterative process in which successively 
closet matches to human performance nu)dels are made, Nevertheless, the 
distmctii>n is a useful one in ctVij^iderThp; tlve-kii1f?ii nfnnvi.*sinie!Ha 
processing analysis that will be nu)st valuable for inslructiun. 

In the remainder of this chapter. 1 consider information-processing analyses of 
several of these kinds. I describe first stime t)f our work in rational process 
analvsis. wDik that was explicitly ct)ncerned with instructional design require- 
ments. Next, I describe some empirical analyses" of tlie same kinds of relatively 
simple ta^ks, and c<nisider the relatit)nship between rational and empirical 
luialysis for mstiuctional purposes. In a final section, I consider the problem of 
mure complex tasks problem solving, reasoning, tasks that we use as measures 
ol "intelligence" and aptitude and what the role of formal simulations and 
empirically studied information process models niiglit be for instruction in such 
domains. 

Rational Task Anaiyiis for Curriculum Design 

Rati^'ital t>i>k analysis can be tlefmeil as an attempt to specity processes or 
procedures that would bo useiTm Inglilv efficient peiformaiice of some task. The 
result Is a detailed descri[)tion of an "idealized'' performance one that solves 
the problem in minimal moves, diies little "backtracking,** makes few or no 
erri^rs. Typically a rational task analysis is derived from the structure of the 
subiect mattei. and makes tew explicit assumptions about the limitations of 
linman mein»»r\ ..apacitv or fu-rceptual encoiling processes. In many cases 
inturmal rtiiunal task analv sis (W this kiiul can serve as a way of prescribing what' 
to teach (i.e., teach clnldren to perforni the prticesses laid out in the analyses), 
and instructh nal effectiveness serves as a partial validation of the analysis. 

in unlrr t»> * onvov tlu^ llavor and intent of rational pr(^cess analysis as applied 
(o nistructiiHK i will describe ni M>me detail part i^f our own early work on 
snn[)le anthmetjc tasks. Ibis work grew initially out of an attempt to apply 
learninu hieiarch\ theorv to the problem of designing a preschool and kinder- 
garivn matht'inatics cuiricuiiini \Vc tound it necessary, in order to secure 
agreement anioni' oin stall on the pr<>b;ihle ordenng of tasks, to inlroduee a 
metlir-d m vvluch the piot esses h> po thesi/ed to be involved in a particular tusk 
pertorniance were explicitly laid out (see Resnick, Wang. & Kaplan, H).73). 
I'lgures 4 and 5 sIkav examples of the analyses that resulted. The top box in 
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When Idst ybject 
has hwn touched 

State last numeral 
.js number in set. 



I He 

Fixed set of objects 



Touch each object or^ce 
jru] only once (i e , 
"rfUTUMTil)(>r" wh^ch ()t)jects 
h,ive been touch eti). 



Tiisi' U in ubjt'f f nf f:H> 
►Nsch tiiTu' '/.'orU i . -.r.jt'nJ 



IVb 

F^»'P»Mtpd tap or touch 
hv ^mother ppr'^on 

Sjy J vvnrcj rjch time 



IVc 

Row of obiects 

Touch each object in 
order beqinnmcj at an 
en(J of the row. 



-FIG. 4 Analysis i>t Objective 1-21", "(Jivcn i\ fixed ordered set of objects, the child can 
vounf the obiet ts " ti roin '"'Wisk an.Uysis in LumcuUini desiiMi: A hierarchically sequenced 
inir.»dm lnry nuthomatus curruulum" b\ 1 II. Resuick. M. Waller, & \. KnpUm, Joimtal 
r>/ l/v'/zf// fii'haiior inalvsis, I''7^ 6, :\n. C.ipvrmht 197.^ In rho Society for (he 
h.\pcrinient,d \n,dysis of Behavior. Reprinted by perniissicni.) 



each t'lgiut* sln>vvs tho i:\sk being jrialy/cd, the entry above the line cicscribirig 
tito prcscntoi! Minuihis .nu! the entry behivv the line the expected response. The 
second row in each ligure shows a liyptuhesi/ed sequence of behaviors engaged 
m as the presented task is pert'ornied. Arrows indicate a temporally organized 
procedure or routine. The lower portions of the charts identify capabilities that 
are thnui'jtt to be either necessary tc^ performance (i.e., prerequisite , to) or 
helpful m learinng (i.e., propadeutic to) the main task. The identified prerequi- 
site and propadeutic tasks were used to build hierarchies of objectives that 
formed the basis of a curriculum. 
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Numerdl st Jtt*d anU 
a 'it't of ob)oct$ 

C(JUnt out StillbHt 
ijf StJtud 'siAV 
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III) 

Spt of movflable oh'jects 

Bf?ijin countsfuj tho obiHCts. 
moVMTtj t\wm out of sc;t as 
they are countt^d. 



lie I 
When stored numeral j 
is reached 



Stop counting. 



lilt) 

, Numeral stated 

.Rememhor numeral 
while counting. 



FIG, 5 Analysis t»f Objective l-2;i;» "CJiven a numeral stated and a set of objects, the child 
can cuunt out a subset ot stated si/e."' (I'roni 'Task analysis in curriculum design: A 
hierarchically sequenced mtrt>ductor>' mathematics curriculum** by L. B. Resnick. M. C. 
\Vant\ & .1 Kaplan. Journal of Applied Behavior Analysis. 1973. 6, 679-710. Copyright 
1973 by the S*->vU'ty ft>r tbe 1 xperiniental Analysis of Behavior. Reprinted by permission.) 

At the outset, the process analyses functioned for us as aids in developing 
prescriptions for instruction. We carried out the kind of research that seemed 
most directly relevant to thai prescriptive furictitni. That is, we looked at the 
extent to which the analyses generated valid task sequences, sequences which 
aiOed Icarnm^^. of the must complex tasks in the set. Two research strategies were 
involved. First, we conducted scaling studies. In these studies, tests on a number 
of tasks were given to a sample of the children prior to instructitin. and the 
results were evaluated tor the extent- to which the tests formed a Guttman scale 
in accord with the predicted prerequisite relations (e.g.. Wang. 1^)73: Wang. 
Rosnick. ^ Boo/er. M^71). A good appniximatitni to a Guttman scale implied 
strong prerequisite relations among the tasks relatit)ns that specified optimal 
teaching orders. A second set of studies (Caruso & Resnick, 1971; Resnick, 
Siegel. &. Kresh, 1^)71) Involved more direct assessment of transfer relations 
among small sets of tasks, tasks in a Small hierarchy were taught in simplc-to- 
complt^x and complex-to-simple orders. We then looked at transfer effects on 
trials to eriterio'n and related measures. These studies showed that teaching in 
hierarchical sequence was the best way i)!* assuring that most or all of the 
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ciulurcii in d iimup loaipcd all the ohjccMvos. 1 or ihc iniiioiitv who vvou* capable 
i)t loarniiit' thr iiioio complex ob|ective^ wuhoiU Hiterveiung iiisifuction, how- 
ever, '•♦.kippifri'" -t prcietiuisites wa^ a tastei wa\ (n loam. What these children 
appa^•..•l^ti^, tiid wa, acquire the preiequisites in tiie course ul" learning the 
more complex tasks. An important instructional question raised by these results 
IS whether We can malch nislruclioiial stialet'aes lo individuals' rehnive ability to 
k'arn on jfie'ir owrj that is, without i»oini! throiiyji direct uistmction in all of the 
steps ot a hierarehv. ik'tore we aie likely to answei that question well, however, 
we wiH pft)bahly need ttiorc systematic theories than we now have available of 
how learmni.' occurs with nnnimal instruclion (cT. Kesnick .S: C^laser, in press). 

Ihe kind ivl task .uialvsis Uscil in these studies servetl to describe perl\)rmance 
in {entpt>ra}ty onjani/cd sequenecs and to identity general into'rinatioii-processing 
abihtie>, such as perceptual processing (e,i^., f ig. 4, llic and IVc), memory (e.g„ 
f li'. Ha and lb ), and temporal synchrony (e.g., Fig. 4, Ilia), thatare called on in 
p'Mloimin:' a ,pecific complex task. As t'orinal intormatioii-processing models, 
liowev'.'f, the-nial\ses were inctMuplete because they did not specilV every step 
(Ut ex'mple. .f')[) rn!-s were luu typically specilied where recursive loops 
occurrevl) nor did ihev expliciily tleal with (werall control mechanisms or total 
nu-morv loavl In addition, they were not empiricalK verilied as process analyses. 
•MHiough numv ob^ervitions of pertormaikr were made, there was no attempt 
to niaich predicted or *'ideal" performance against actual performances. The 
hierarcltv tests eiinfirmed the validity of tJie task sequenchig decisions made on 
the Ikim^ ot the ,malyvjs, hut thev dul noi necessarily contirm the details of the 
,mai\ses. Peiformarue strategies difterent from those in our analyses might have 
produced smular sequences ol acipusition or tiaiister etiects. Thus, while the 
scahnu and tran-Jer studies met ln^tructlo^al needs quite well, they did not 
constitute vahdath)ns of the models' details. For this purpose, die strategies of 
em[>nical lask anaK sis are needed, 

FrT^pincj! Analvs>^n of Sp^^ctfu: Ta'^k^^ 

What carj • tnfiuical anah >es sULigesl about teaeliiiig specific tasks'.^ An obvious 
possibility i> fha? we might use process models oi^ competent pertormance as 
direct specifkations for what to teach. .Such models of skilled performance are 
pt>N-Viti.il}\ povveitul. However, these alone do not take inti> account the eapabib 
it»''> ^hr !^-;nner a, lie or she enters the instruerioiial situation. I want to 
describe some experimerits we have ihuie that suggest a more indirect relation- 
sln[> l»etwe'Mi vvh.it is taught and liow skilled performance proceeds. The e.xpcri- 
menis suegesi that whal we IimcIi children and how they perform a relatively 
shor! (mie after m .trtich' >ri nut identical but neither are they unrelated. 
Iliey sMijgest that chiklrer^ seek simphtving pi<K"edures that lead them to 
ciMistruct, or "invent/* more eflicient loiifines that might be quite iliffieult to 
teach directly 
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Subtraction In one study (Woods, Resnick, & Groen, 1075) we examined 
simple subtraction processes (e.g., 5 - 4 = ?) in second- and fourth-graders. The 
method was l)(>rrowcd (Irocii aiid others' work on simple addition pro- 
cesses (droen ^ Parkman, 1^72) and open-sentence equations (Groen & Poll, 
1973). That IS, we gave children a set ol subtraction problems to pertorni and 
collected response latencies. Tive possible models Tor pert'orming subtraction 
problems(of the form m - n ^ ?; with i)<m^ 9, 0<n< 0) were hypothesized, 
and predicted response latencies for each problem for each performance model 
were worked out based on the number of steps that would be required according 
to the model. RegresMon analysis was then used to fit observed to predicted 
latency functions and thus select the model an individual child was using. 

Of five models tested, twii accounted for the pertt)rmance of all but a few 
subjects: 

Ihrn'iNi'nting nuulcl Sot a ctnmter to decrease it times, then '*read*' 
counter I*or this nu^dek latencies should rise as a function of the value of//, and 
the slope ot the ret*ression line should retlect the speed of each decrementhig 
operation. This li: ction is shown in Fig. 6. 



(j 1 J 4 5 6 ; ' a 

FIG. 6 Plor of TLMCtion times for second-izradcrs solving subtraction problems of the form 
m n - V Decrementing' Mode I. Numbers beside solid dots denote actual problems (e.g., 
•54. 65 signifies (hat pn^blems 5 4 and 6-5 both had a mean success latency specified by 
the •) llnderhned problems were omitted in the regression analysis. (From "An experi- 
mental test of tlve process models for subtraction" by S. S. Woods, L. B. Resnick, & G. J. 
Gn^n, Journal of Educational Psychology. 1975, 67(1). 17-21. Copyright 1975 by the 
American Psychological Association, Reprinted by permission.) 
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Chntv moihi DcponJiiiii on which lewor .steps, pcrlorni cither the 
JccronKMiting rinilinc I previously descrihedlDr another in which a counter is set 
tu n and is tfien vurcnumwd until the counter reading matches//?. The number 
o! nicremcrjts i> tlioT} "read" a-, iho an->wor. I'or thiN ini)del. it is necessary to 
a>sunie a pruce-^N ot choosing whether to ••uicrenicnl up" or **decreinent down/' 
\Vc assume rhat ifie chiMce pr.»cess takes the same amount of tune regardless of 
the vahies of m and On this assumption, latencies should rise as a function of 
wlnchever is NUialler, // »>r 'Ilns function is sliowti in Fig. 7. 

Individual tiara weie anal>/ed first and a best-fit iliodel selected for each child. 
Then wluKhen were luouped accnidmij to the nunlel they fit, and the pooled 
tlata weie aualv/ed. All ti)Urtli-giavleis and most second-graders were best 
tir by the choice model. It >eems unlikely that during their arithmetic training 
Hie *. hildr-Mi had been directly taught the choice model for solving subtraction 
pt 'bl-fn. Ih'- prtM .'tlure involved would be dilticult to communicate verbally to 
^ and 7 yoar-«'ld>. and might coiu'use rath^'r than enlighten children at the point 
ol (heir lir.i vxfx.suro to subtr;iCtion. Most probably, the children had been 
taught imii.iilv r- «Mn.iruct ni set (increment the counter/;/ times), count 
out ilie // >ef (deciemeiit // times), and then count ("read out") tlie remainder, 
liii. ;ili.M»rifhm close to the one described as the decrementing model. The 



Fid ; r ! M >fi lor >r( mjmI uler - sulvin;' subfr.ulion [irobli'ins: Choice 

M«idcl MI\ ni. ni >n r,.uis fhe mi illrr of n ttjtl O// n) " I rom "An experiinent.il test (»! 
tivt» privO'.. nu^icK Mibtr iction'' hv S S* \VM<,d^. I.. B Kosnit k. ^A t \. On^cn. Journal 
*»/ /-J'^v/f/.'W /'vw/jn/r»>:i , I^^?-;. 67M). 17 21 C.^pnndit l'^7^hy Iho American Psycho- 
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decrementing model is in fact derivable from the algorithm we assume Is 
typically taught, by simply dropping, the steps of constructing the hi set and 
actually counting the remainder. Thus, it seems reasonable that a child would 
develop the decrementing model quite quickly. The choice model, however, 
canni)t be derived from the teaching algorithm in so direct a way. Instead, an 
invention ('the possibility of ci)unting up frt)m n) must be made. This invention 
is pri)bably based on t)bservation of the relations between numbers in addition 
and subtraction over a large number t)f instances. Yet the inventitin appears to 
have been made as early as the enjl of second grade by most of the children. 

Addition !n antither study, Guy Groen imd I have been looking more 
directly at the relation between the algorithm taught and later performance. In 
the subtraction study we could only guess at what children had been taught, 
based on our gciu'ral knowledge of elementary sclK)t)l practice. In the additio ' 
study, we controlled the teaching by doing it ourselves. We taught 4-year-olds to 
solve single-digit problems of the form m +/■! = ? (where m and n ranged from 0 
to 5) by using the tollowing algorithm: (a) count out m blocks; (b) count out n 
blocks; (r) combine the subsets; and (d) count the combined set. We then 
kept the children coming back for about twii practice sessions a week for many 
weeks. As saau as each child was performing the additiiin process smoothly 
usi^lg blocks, we took the blocks away and asked the children to give their 
ariiwers on a device that allowed us io collect latency data. The children's 
typical response when blocks were removed was to begin counting out sets on 
riieu finger^i. Eventually, lu)vever, most shifted lo internal processing. 
/ I-arliet work by Suppc.; and Groen ( 1^)67) had sluiwn that by the end of the 
first grade, most children added using a choice-type nmdel in -which they set a 
counter to m orn, whichever was larger, and then incremented by the smaller of 
the two numbers. This is kntiwn as the nun (minimum) jtiodel [because the 
latencies fit min (nu n)] . A few children used a model of incrementing m times, 
then incrementing n more times, and then reading the counter. We call this the 
sum model (lalencies fit {m + //)].. The sum model can be derived from the 
procedure we taught bv simply dropping steps (r ) and (J) of our algorithm, and 
it requires no choice. The min model,, however, requires an invention based on 
the recognition that sums are the same regardless of the order in which numbers 
are added, and that it is faster to increment by the smaller quantity. 

fM)r live ol the six children whose data have been analyzed thus far, it is clear 
that by the final two test sessions the model gave significant and ^'bcst" fit. 
In general, the trend over bh)cks of trials was Tor subjects to be fit well by the 
min model as soon as they stopped counting overtly on most of tlie trials. It is as 
if these children disccwered comnmtativity as soon as they were confident 
enough to stop counting on tlieir fingers! 

In the studies just reported children are taught a routine which is derived from 
the subject matter. After some practice but no additional dirt.>:t instruction- 
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rlicv pcrt-uin a diftcront ruutuic. one tluit is nu»rc otTiciciit. I he cmciciicy is a 
rcsiiit of tcwer steps (not. ;rpparciUiv\ faster pcrturmancc of component opera- 
tiuns), which u\ turn requires a choice i^r decision on the part of the chikK A 
>trKtI> ali-oritlirnic mutine. in otlier \vi>rds, is converted into another routine 
which turns out to sdIvc the presented pu>()leni more ctlicientiy. 
- A simihu fiiuUn;! has hien reported hy Wallace (1972) in a study orinforma- 
tiiMi-processiuiz models m class inclusion. Alter havinti received training in the 
p^ocesses revealed by an udormation-processing analysis, sul)jects were presented 
a tvpkal class inclusion task in which they were asked to tell, for example, 
''Which }s mure, the red ones or the triangles'.''^ fhey had been taught to pass 
rhroudi the ol^je^ t ariav twice, each tune quantiiVing the objects on one of the 
ditkrcnt value dimeHsiv)ns named and then comparing them to determine which 
was more. At the posttest administered unniediately at'ter training, it was found 
that ,oine m! the children were able to perform the task more efficiently by 

•iiuantdvmg on rhe iusi pass only obiects having only one of the dimensions 
named h\ the pernnenter. Foi example, Wallace presented a subject with eight 
triangles, seven winch were red and one green. Asked 'AVhich is more, the red 
t»nos f.r the trian.i'Ji-s one siibiect asiswered, "There's one green triangle and 
fliat makes it mme triaUL^les" (W^allace, 1072, pp. 15-16), ,Since in the class 
Uichision fa^k the set having onlv one of the named dimensions is usually the 
nnri^.H- subset, thiv procedure qiiickly yields the answer. It seems likely that a 
phenumet!on of tins kind, that is, tiie transtorm,iti(ui of algorithms by the 
learner, ivmore i;enfral tluin we have thought up to now. At least some process 
d<ita' thaf a[)pear ditt'icuir to interpret when averaged over time may show 
ii.teip?etabie loi'iil/tr it ufiei. e.u!\ and later phases ol pertormance are exam- 

■ Hi.'d '.ep.ujtt-K 

/ 

Task Structure*. SktlU'd Performance, and Teaching Routines , 

Wh.it Jie the in?phcations Mt Hndin^^'s of tins kind lor inslrnction*M)i\, tiie face of . 
If. it UMiild .«..ni !lMi ',\e wjvrhi abandon tiie algorithmic rputmes suggested* 
b'v tahoiuil aualv aN \u !,ivor of vlncctiy teaching the more environmentai^ly 
responsne procv^^e^ that appear to characten/e even, semiskilieil perforriiance. 
We ongin, nrnifua words, to conclude that the initial rational analyses arc 
wrMh''. >Hue ih.'\ do nnt m:iteh skillet^ performance, and that they should 
fheretoT.> !.<a he M.ed m nisirncOon. Rather^^- should perform detailed empiri- 
cal ana!v.e^ of Nkili.^.h porforitiano' mi all of the tasks thai a curriculum 
romprise. and UmcIi direv fK the r(»utines uncovered in tli? course of such 
an.d\ >is ' 

Sii?h a c'lu lu toti., i heii-v. um^M \n: im.laken. It rests on the assumption 
that etf!c;.*r(J ii)Nfriuti*>n isniirs\un!v direct ,ips!ruction in skilknl performance- 
strarcgi's. rafh:i tliar^ msf ruction m roiitjnes that put learners m a gotnl po.sition 
fo Jivcoyer or u;vent etiicient strafe.ues toi (!iem>elves. fhat t> what the children" 
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did in the studies just reported. They learned a routine but thou invented a more 
effieient pertormance for themselves. It seems reasonable to suppose-although 
empirical tests comparing different instructional strategies are needed to draw a 
strong conclusion- that the teaching routines in these studies were good ones, 
because they taught the specific skills in a way that called upon children's 
discovery. and invention abilities 

To put the case in its most general form, it would seem useful to think in 
.terms of a **triangulation" between the structure of a task as cfefined by the 
subject matter, the performance of skilled individuals on a task, and ?i teaching 
or acquisition routine that helps nt)vices learn the task. There are three torms in 
this conceptuali/ation; all three must stand in strong relation to each 'of the 
others-thus the image of triangulatioa. This relationship is schematized in Fig. 8. 
iMost empirical information-processing analyses have been concerned with the 
relationship between the elements defining the base of the triangle-that is, with 
the relationship between the structure of the subject matter, or ''task environ- 
ment'' (A), and [)erformance (C). Thus, most information-processing task anal- 
yses -ire state theories, describing performance oh a given kind of task at a given 
point in learning or development, but not attempting to account for acquisition 
o! the performance. The ratit>nal prt)cess analyses that we have developed in the 
course of i)ur instructional work have been concerned primarily with the 
structure of the task (A) and an idealized routine that represents the subject 
matter well -and thus prescribes a good ^teaching routine (B). Our validation 
studies have in effect been tests of" the extent to which the tdaching routines and 
sequences derived through these analyses succeeded in conveying the subject 




FIG. 8 Rclatit'ns hetween torching rnutines. performance nnilines. and stnifture of subject 
matter. 
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matter tt) learners. The diseussuMi in tlie p.ist several pages has been emieerned 
with the relati()ri5ihips between teaching routines (B) and performance routines (C). 
Chaining unje.rst;uiding of tJie ^'transformation" processes that link these- two 
mutmes is a necessaiy step ni einu[)letiim the ti iangulation that jMits information- 
processing models into clear relationship wilh instructional desii;n. 

According to'thi^ "li langulatmir* niUion, there are three criteria to be met in 
choosing a teachmg routine: 

1. It nmst ade.qiiatelv display the underl zing structure of the suhjeet matter. 

2. It must be. easy to denumstrale or teach. 

3. It imist i)e capable i>l'transformation into an efficient performance routine. 

'I he teacluiig routine, then, is designed to lielj) facilitate acquisition, it provides 
t»ie Ci)nneeting hiik between the structure of the subjeet matter and skyied 
[)ert(.imanee which is <iften so elliptical as to obscure rather than reveal the 
ha^ic structure ol the task.. 

leaching routines, in other words, are constructed specifically to aid a.cquisi- 
ttv)!!. I he tlesii'u t)l (caching routines may require considerable artistry, and not 
ail routmes will be succi-ssfnl in meeting the criteria just laid out.oLet us consider 
srmie examples. To begin with our own work, the^'addition routine CIrocn and I 
tauglit is an instantiation of the 'Minion of sets" definition of addition. Thus, it 
is a mathemaUcailv "eoriect" procedure, and represents the subject-matter 
structure clearly. The Kmtine is also easy to demonstrate and to, learn. Our 
4-year-o|vI subjects (who Knew oiil> how to count objects when they began the 
evperiment) were performing addition virtually perfectly, using the blocks, after 
aboiit a iial! hour of practice. The routine we taught is awkward and slow to 
[lerltuin, however. None o\' us would like to have to u.sc it in our daily activities, 
and neither, apparently, divl the 4-year-olds. Nevertheless, the data ,show that the 
routine 's translormable by a series of steps we can imagine but cannot fx)r the 
moment document empirically to the ruore efficient perftirmanee routine of 
the fuifi model, hurther. this pertormanee routine exemplifies another aspect of 
ihe suh}i\i matter structure, conuiuitativity . I hus, the proposed triangulatioij is 
cmpleted. A leaching routine derived bv rational, process analysis of the 
subjeei-matter structure is transfiunied tt)a performance r^mtine that retleets an 
even more sophisticated definition of the subject matter. I 

Ihe case is ^lnular (or li.e subtraction study. The routine tirat wc/presume was 
taii'jht instantiated a partilioning-of-sets definition of siibtra<5tion. The perfor- 
mance routine derived l)y the children is aiot only more efficient; h also retleets 
a more sophisticated a.spect of the subject-matter structure, namely the comple- 
mentary relationslup between aiUlition and siibtractitin cipcrations. . 

Not all teaching rcmtuies meet the criteria . enumerated above. Some are 
awkward to teach: such would be the case, for example, were one to undertake 
to leach 4-year-()lds the min model for addition. Others fail to display the 
subject-matter structure in a way that is transparent t("i children. This is true; for 
example, in the case of traditional algiuithmic methods of teaching carrying and 
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\h'U V,'! ^ItM d ^ 4!^p!.*v rh ^ and;rluni' .inictUT^ i\\i r aiuhmctic and il > 

S. .i, .'5 ' ; ^i, ^: p I'l; lU* dov.^l ^pod in <^fd:i displa\ ihc sub- 

llicv .ir ri'H vi^!!'* !iMpp''d "t^?- ,t pw'rtnrin.tf c ' loutiiu- that iNi'ttu u-nl uiu! 
differ \!i .'xaiiip! • ^d ,i p.-rh niKuic^' if^utnu' that lad* "ii the aiteritm ol 
traii 'H!! ifnhtx iv Hiaf \vas prop^'s^\i h\ Hninor ( lor traduri^r factor* 

in:' ot .pi.nh tiu: **\prt"v.ioji Hnnior \vas NMccc'jslui in tcachni^ tlnrd-i^radcrs to 
pt'ih»nfi ?!{ • t.i» fnr r,'/ ♦porafi. r ^a crcatiiii! a "niodor' id (Ik- expression using 
bloi;- , \s !i. vV i ir I li' ^i. lartv square is v uinls Ii>iU' and A* wide, thus 



1 




nu 'i f u Hi! > irp Ti I r ij i t ir iM - ^ h^ns ( bi Sciti.iros nt cwr iru rcasini* 

: iTi.*r i. ' (t v'^rh . iTipnTurifs ilri^iTi SMn'r- 'ir^'nts nn ins!riu;M*.n lUusrr.itL'd with 

rrtcrt'tK.? t=> tu.iiiu-m iu :M»v I. S. Hrup ^ in f . U. Ihleard tl aj/H/eonivv i>//rf2r/ii/7^MW 

bwtrui thf)^ ih' 'k>V,/ >. ,;r^.>'*^ ' V,S\S7- (Part h ( hiv.i^o C }n« a{,v' rnivcrsitv Press, 



( • i Hi r.=d 1. V units lorm ir d ^uh- una .vjdi-. Ufu . ( v) Hh.* siiiai! l ubo js / X 
/. 'Ui^ih \^ .hnui At the riclit ol the fipue Ih), oluldren can arraiigc iht^sc three 
vl iiiiM.r> ;r ;;i.t!i ^ »Ahi. !i vvill iuivo o.juai taLluis o , ( v t 1 ) ( v + 1 ), {x + 2J 
(A ^• .^^ and wfiuh can aKi» he exfuessod a • quadratic^ e + 2v + I ): (,v- +' 

^^'1 * ir.) Aiiowiii- Jnldieii rn nianipnl ite tlic hin.ks may he excellent for 
d^rlayimt and prnmotinf Hia^'ht tutu the sifncture o{ \\w snhu'ct matter, hut 
theiJ appears tii he no wa> Iti translofni the sijiiare aitanivment routine to a 
^1. iMW\i\ pfaeedure used without the hlocks. 

(Virani other teachniL! routmes m early uiathematici. do meet ilie transform- ^ 
ah;lH\ uf?r rion \\hi\c still r 'preHMilinu. the mathematical structure, hor example, 
iihMsurefikMit cafi hr taudit as a process ol divulmy Uito et|iial units Wertheimer 
( diil this when he ; ,ed division oi a tiizure into squares a. means oi iuidmg 
i\ At 'A Bearisoii ( H, a less widely known experiment, uuluced a general- 

ized ->f' ,t rv.ifh<h . ^lu.ept h\ showint' children how to count the number (d*30-mi 
l"Mk •] fhar wer - pMur'-d uito beakers n\ dilierent si/es, and demonstrating the 
pri H iph" ..1 vnn .'fvation b\ pt)unng equal quantities t)niquid into containers of 
dtrr*-reni .li>ip -.^ Ih:, ;»enerali/etl principle of measurenieiu, exemplified in the 
hqujd nieasnii.ni Mir ()r.Kedure fauj'lU. produced conseivatiori responses in tests 
"I iMunh.^i. mass, lcn;:;h, coutimious and tliscoritiuut)Us area, and cpiaiUity that 
la. led tor at least ax months. Snnilarlv, the number haw system ( including 
tJirvmi^ and ht^rrowir^*!) cati he taui^hi usiim blocks in si/es ol one, ten, and 
orK> fumdred, placed rn units, tetis ami hundreds cohnmis as in Fig, 10 (ef. 
1)1 With these blocks, carrymg can he represented by trading 

^■■t ■ -.Khunum extra 1 1^- , more than nine) blocks in a eoluinn lor a larger block 
fb. *t Is [»faced m the u-xt column. Such an exchange would be necessary lor the 
ht)r?'..nj di.pfav in 1 10 ht-fore the blvck display cmld be notaled. A reverse 
'Ac^iaieA '>p. ?a!!;nf can be used to represent subtraction. In each of these cases, 
IS Eht. phv.jcal repr.'-eruation is dropped, a performance routine can be eon- 
sfrucfed which imfialK perfi>rms '\is it"' the representation were present and 
fiiei» '.'f idualU becomes more .distracted tnuii it Tins is the kind of transforma- 
t:^'-u we h -ii-ve oecuri • ! \u our avlditiou teaching exf^erimenl. 

\hr i^Mi: r,il Av:vv.\inu that I wouM lik*^ diaw from these observations is 
tl .a m.-st pcMple even (juite v>>ung children use envirruunental feedback to 
-.inpblv perturrnaiice routines, rhe> do not accept the routmes tliev are shown 
a/ ^eVv -fr. ' huf r ith M .^s starling j^oints. They invent even when we teach tjiem 
^^'-nflun, Ohr iinplhaiiiUJ o! this hue of fhiirhng is that the traditional hue 
bcfw '.'fi ai:.!oru}.nuc and luventive teaching dIsappear'^. We are not faced ,so 
Uiuch Will, ,Riiou e between icachmi: h\ rules- and teaclung by discoverv, as with 
a pTi'h] -m t)n hii;' leaclnni^ rules that will enhance the prohabilitv of dis- 
"»v"r. tuie. iliai ^nmehow tnvii ' ,mipht!t.atiou or combination with other 
rule-, Ihi> WMv uf thinkiiu! ab.o draw, attention 4o the extent to which we 
pre-entlv depend, ir; :»ur normal itistructioiJal practices, ou this knul of invention 
and discovcr\ b\ learners. Out instruction is rarely omplete. and rather than 
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wImI \\r i.„\Kh. uHeii Ics^ ihMi ol'.'L!:tiit nistaiicx's aiKl alsn expect 

iMrrr.'f . I ' und ih; iif: !/ilvir.j pruicip! t^r thein .cKo^ 7 his -uiigcsls that 
«ii!tcrcni»"s in liMrrurii' ahiliiv niton e\*[)rv'^scd a^ mtv'ih^ioiicc or aptitude may 
Ih ta* t h: lifUv-teruv tti th:^ aiiiuitnt ni ajpp.>rt jnihvuhial-i rci[iuro m making the 
sitnphtv ini": aiui .^vKiin/iw: :»iv.Mif «tvii, that pruduco skillcil petl!>rmaiiLC. Sume 
individuals wall seek and luul ^udei Ui ihc IU^^l disordered preseiilatioris; nu>st 
do vv di il ihe preseriratjotis i i e , the leachiui: routnies) ateg'Uid reprcsctita- 
h'aiN i>r ii!^d *rl> int! struv^uros, stili others may need expheit help \u (iriding 
^'Mi' !i.'i!t >tr it<-uMe^ !oi pcif irniaiKe 

Ar\ily/ing arui T^Mchfruj Gf'Merrjh/t'(J "Learnirnj Lt^irn" 

I* ■•pi'' tpp.srrnfi'v tiv^ nl -voit within fiie enrjhiies i^t^tlL'^nthniic itistruction. 
\' f fh^'i'' I , Aivji'stcd, uuhviduals ditler sitbstantiaily in how goi)d thoy 
ir-.' at fhf ,e :u\--"Ji'>u, Ihu.. one appropriate Concern tor instruction is the 
p«'..d>ihl'v ot f'.MJiift:' .HMi^^ral stiatriMes (or l^vor^(Ion ami disci^very strategics 
fh if ud! iiidp ieariu'f . (o [v/ less dt pendent on the instructor's elei^ancc in 
P'L'-.;nhiu' p.nUiMiar Kr-ks An interr'st m teaclunjL' such I'.eneral 'learning to 
IvazTi'^ ibiljfio. as Mu'v :jrc "tfen * alied, ha yl^een widelv expressed by educators 
' and pvv.jj' d*'ji >r . Ilo\vever, few siu cesses kave lieeii reported, and there ishttlc 
>L:.'nu!iv h.tM~. at iho pre .er.t tune for siieh nistruction. As m the instruction of 
'th 'I A\h\it\ . !h tir-.t ,rep ui leachnn; eeneral learning ahditlcs is developing 
i p^vJn.|ot*n a! description a task analvsis of the competence sought. Such 
anal'v M* .\ti • < >i)l\ :!*.\v bri-Miiniru! Ii^ f>c»:oine avadal^le, 

\ .M 'V.tTf.' fu;!n?> n 'tf iiih uniaftoti pitK'essiru! anaU'ses ol proldem-solving tasks 
-varotiN kv\iU [u>'Vid;.* a potential l^isis [tir iristrnction. However, it by no 
art-, ovuiefit. wirfj^iiit Jnrfher testing.' ...ul experinierttatioii, that analysis of 
p af^nnarive on complex [nobletnsvan lie dnectlv translated into instruc- 
li^'f il in t a\ r.rt .Ti , Ou ' i -J .tt tht, poNsihihtv has fn-en earned tnil recentlv by 
lltrnt. lli'i/nu'* (I'^'s) \u i!i ^'M-Mrt to determine (lie iiistructabihty ol a 
'*e?ali/t'ii pa f tern det.'.riiiii ,kill, lloj/man looked a! an analvsis ot behavior on 
ATI ;o>rnpi!^M' it 'a>ks lhaf had he^'ii carrietl otit earlier bv Kotovskv and Simon 
(I ^ '^^ Ih.' k^n^v.kv and Simon analysis uleiUifieil three principal subroutines 
••a di ,.-^ ta i' rf»' t>if?' n! \u I 'lter srr[.'> i/p^mplelion t.tsks sinuLir t(Uhose used 
"t! Tiian\ ir;n^If.er'> • t^.ts Wi:,*: were (a) defect nit! the "[lertod'' of the 
{ort .T', th,<r 1 , liio rrf^eatv!/ lUiUi .j certain number m} letlers, sucli as three 
Ui 'h • t^ ''^'''Ji ihn;. Iii!"ini ;a lour m the pattern delgelghtg . . , ; fb) 
f' r. [ tfunir ' ill ni'i:' fh it e -f;' r lU- , ■ a^ [j .vmboi m ihe [leriod. and (c) testing tlic 
'.fif .TT 'd r:ii tf il h^>^d^ ft. T. ill th" I'Mtors lhat h.ivebeen prescntcil. These 

suhf. ajtiTh' . in rurTi were s!it>w!i to he dependent n\hn\ reeogni/ing three basic 
relation-, her-.*. r-nis ui the series presented, ulvntitv (e.g.,/ to ():nt'xt in the 
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alphabet (e.g.. f tu f^h or backward m-xt (e.^^, h to >r). These three relations 
exhaust thu^e that were used in ihc Thiirstone (Thurstone & Tluirstonc, IWl) 
letter series cnnipWrii»ii task wliicli tlie Kotovskv and Simon study used as a 
bu-^is, ailhongh a much nuuc extended and complex list ot relations could be 
used in generating series complefon problems. 

Based on the Kotovsky and Simon analvsis. Ht>l/man taught children trom 
first through sixth grade the stragcties lor recogni/ing the three basie relations 
and Tor finding periods. Instruction in finding periods was d(Mie in such a way as 
to prevent extrapolation to other subroutines. Children trained in these relations 
and periodicity subroutines unproved significantly on the letter scries comple- 
tion task tr»)m pie- to posttcst. They also iinjnovcd significantly more than 
control children who simply took the pre- and posttcst and did not practice the 
series completion task. Comparisons of particular types of errors for the training 
and control group'> showed that the trained children improved significantly more 
than the contri)ls on the more dilficult relations (e.g., next as opposed to 
identity) and on the uenerally more difficult problems. Control children showed 
a practice effect, due in experience with the test itself, which was limited largely 
to improvement on the mo\i easily detectable relation (i.e.. identity). This study 
suggests that as information-processing analyses succeed in identifying the 
processes underlying problem solution, these processes at least some of 
them- can be directly taught, and that individuals will then be able to apply 
them til solving rclativelv large classes of problems. 

What possibilities exist (or analyses of priiblem-solving abilities that are even 
more general than those Hol/man found, and what might these yield as a basis 
for instruction that would be truly generative of learning-to-learn abilities? 
Robert Cllaser and I have eorsidered this question in another volume (Resiiick & 
Glascr. m piess) tn which we described several studies of invention behavior in 
mathematics and related tasks. We argued thaf the processes involved in problem 
solving oi' certain kinds were probably the same ones involved in learning in the 
absence of direct or complete instruction, and that instruction in those processes 
nught ct)nstitule a means ot increasing an individuars intelligence 

A model ot problem snivmg was deveh)ped m which three interacting phases 
were identified: (1) priiblem detection, m which the inapplicability irf ^'usual 
riMitines" is noted and a problem or goal formulated; (2) feature detectitni, in 
winch the ta .k environment ( the external situation, which includes both physical 
and soeial leature.) i^ ^canned tor cues to appropriate responses: and (3) goal 
analysis, in winch uoals are successively refomuilated. partly on the basis ot 
external task cues, in order to yield soluble subgoals that contribute eventually 
to sohitnni lit the t.isk as presented A ^tudy by Schadler and Pellegrino (1^)74) 
has shi^wn that leiiuiiing the subject tn verball/e the goals of the problem and 
his or her strategies for solving it before making overt ukwcs tt^ward solution 
greativ enhances the likelilioi>d of invention. Along similar lines, it seems likely 
tJ-at wa>s can be found to nuke individuals more ccuiscions of the role of 
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•-i;v;T.-f:iT. ;;iT,j| c'i^'-. IT! p--l)i-;?n .-ivir.i: : > \,\i.:h AL.ih:'Jw> n\ loature scanning 
IS I his uisiruction ^h'nild enhance the HkeUhood of their niUicingcues 
,rh.it ; • :!^p? ^Vy : u ti^ •liN uiti!.' leco-iii/nij^ jiui v>!!U'how "Jeaotivanng" those 
tlui pr-iinpt nieftecrivc acrioris. I this i^eneral argument '^S self- 

r-j;."ila!i:>n i> a ni ij^r JiaiatJerr.tk' >! ',uca\v,!nl Ic irning and problem 
R-.'.i,!ck iiid lis:!-. (!u pio.>) [lav- -.lu'ivstod that a similar form of 
uisU'ivti'.^r !i; ..>!isv.i-'ti. uv.' < t M'lt ipkNtiMfnift' t!hl vli-ni'^nfurmg strategies 
niu'lit ■ft.viiv.' w.i\ ■Mih.incin^ r',Mdiim compIohe'i^^.)n abilities. 

Ih' ^p -L'tu surliest?. 4 N That can be «»ner;'d at thi^ time tor instruction of • 
>V!ior,u;"d i.arnnii' abiiiti.-s au* linnted, since rc!ativel\ Httle work has been 
■1 'n- ihuN fai :.M J.'v '!> pirk^ ;,i,k .inaK-A-. (hat charadrn/e these general pro- 
V.----. ;n Misrru^ tjblc '-mis Rational a!ial\ sis seems k-ss likelV' to viekl good 
.'i:- '^ti-fr, f.>r i:ci^'rali/ed al>ihti.'s iUah Un specitic tasks: thus empirical task 
♦ , ic. , . r -u) Iv.' . ailed lor. l uiTlier. the rigor tnnnal suiuilation models 

MM. ,tv. tjl;;. r:ipor?anf wher.' ihv pi< >cesses aie litlk' understood and the ta.sk 
":viT mtnrr:! . - ^ .civ Ntruciurcd. as is often the case where probk'm solving and 
' ii '' ^ J Ibiis, With lespeci (o tins most important goal of 
J'i -Jt'i, f{or^ ii prMf^lilv U- u.\:''..m\ h> ciniage in the mi)st costly and 
"^^J'^j ''^nn:^ r i.k aiiaK >i «. that l^. flM.e thai arc formally staled and 
•/rnpirkallv vahdar-d. To the extent that the analyses identity in^tructable 
P''^' -tMicrh-n ii cxpcnrnerM . can vrw a^ ofie of the major torm^i of 
'^'■'P''' '^' ^ ilidji; >!i or fhc tvjrfoatn.inc./ models proposed. A mutual interactitni 
''■'■^.■::\\ .ci -nriric -r^l uisfruclioiial . 'ih. ertis can thus be envisaged. It is. then, 
^v;rti I .{v-,T f,, tij..,,. /cji/ral ahililkN in Icarnnig, thinking, and problem solving 

^' ^ TTn.tf 1 ai [H an- ai.alv M , rnav nllirnafeh have the most to i)ner to 
■'■■■^U'-i- o a-. .tiKi ai.,rri;,'Moiu,i ,'Jt,-^s n, p'Acho|oL»[cal knowledge. 

ACKNOVVLF;DGMFrjTS 
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Adaptive Instructional Systems: 
Some Attempts to Optimize 
the Learning Process 

Richard C. Atkinson^ 
SUinfoni i/ntvfrsfty 

INTF^ODUCTION 

One cannot help hut question the -jigniticanct^ n[ ps\\'liolngy\ aintribution to 
the vJevolopincnt t>t eltoctivv nistnictional prncoduros. On tiie ouq hand, psy- 
choluuv [ia> been wry innuenlial in the ttckl of education. In the hist 25 years 
ahnosf everv major nmnvjtioii in education programmed textbooks, behavioral 
nb|ective>». ungradetl svli ^Is, individually prescribed instruction^ computer man- 
aged and asMstetl instruction, token economies, and tailored testing to name a 
tew caft be traced to ps\cliolog>. In many cases these innovations have not 
been diie to p\\chohnu^ts primarily iden tilled with education, but rather to 
laboratorv scietHisis wlune research has suggested new approaches to instruc- 
tiiMi. Psvcliolt>gy can be proud oi that record of accomplishment. But upon 
closer examination, it is evident that these accomplishments are not as closely 
hnked U) p^\ cholot^,kal researcii as many might believe. Psychology has sug- 
gc Jed I jew aj)pf oavlu". t'» education, l)Ut lliese suizgestions have not led to 
sustamed researcli protuaiiK that have the promise pioducmg a truly elYective 
theory «»t mNtriiction. Rather, p^>cholo^y seems to provide the stimulus for 
^innovatioru but mnovativUi tliat has not in turn led to a deeper understanding ot' 
thi' ItMiinni' pf oi, ('ss 

\Vh> lias p^ychi •l*>u> rH»l had a mt»re substantial impact'' There are several 
reasotis The bnghles! and ablc>^ young psychologists usually are not attracted 
to educational rev.Mrch, and the research that has bee-)i done tends to be 
piecenuMl. noi piifMHiifc' pr^blenv. in leal depth. This picture may change in the 
near hiture ihi?' the hnuied nmnhrr jobs hu new Ph.D.s and to society's 

'Prcsejit jTtili.jM' {>cp.'if; DK-'M.-r, N.itH'r>,i[ Sui^tut- I i^umljthni, WashiriLnon. D.C. 
2f>S5ii 
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if^crt.M.ffiL' crnpluMs oti appiic^i i '^wMr*.!! I Ik- ni^j.* v•rl^u^ piohlrni. linwover. is 
riiat p>vcli>»i-vUNt. know a izrc.it ueal alvjut Uk' aeipiisUit»n nt individual lactsand 

kili.. f«rit \ ]!'!!>' .»lM.iif h> >v. ih.'M^ c -'inbiiK* to i.nni a riu-anuitzlul mental 
%triii;nir'.v 1 itoctivc riu'Jij.Kis acquuiffi' skilKand Lu lsaro iniptHiarU, but the 
niait'r pi'^hfi-!!^ i> ilw df\i'!opnu*nt ol khM\vK'div Mnittures that are more than 
the smii ir:divKhiii iattv In uijei lo deal eltediveK with ediieational 
prnhleins. we need tliennes lha! hdl lis how kimwledije h represented in 
nK'nior\ . h^w inhirniatmn is u'tneved !rum that knowledije structure, liow new 
inhirinatii'n is added to the skuctuie, and how the svsteni can expand that 
knowiedue strnciure hv MMl-taMierative processes. I'fie development ol such 
theork's is undoi w^iv . and nicreasmi'lv wc.rk ni co^nnlive psvcluMoijfy is moving 
in that directum. Ihe conrnbnrion.. ni Anderson and l^)wer ( M)7.M, Newell and 
Simon I \ 972), Riimelhart, landsav , and Norrnaii ( P)72), and Schank ( M)72) are 
examples ol snl>>taiftial etlorts lo develop Ci>mprehensive theories of cognition, 
and n Is ah!Md\ vvidt/nt lhal this woik will have implications Tor education. 
Sruh ihr.nie. \mU not simply add another wrinkle to educational research, hut 
wjI! kiv tile loufMlaiions loi research encompassing a larger set of educationally 
sivMnlicarft piol^;;m« than has been considered in the past. 

I'M tfns paper I want to review ihe ont'onnz work m mv laboratory that has 
implications toi jnstiuction Sonu-ot ihal work represents attempts to deal with 
the issue ol complex kno\\iedi:e structures, whereas some is more restrictive^, 
dealmv!. with the acquisition specilic skills and lads. AH of the work involves 
compuleidMscd projjranis ol instruction used on a daily hasis in scho^ils and 
coheges. I hesc programs can best be described ds ailaptivc instnu'tl<}nal srstcms. 
Hv that term I mean two things, { 1 ) the secjiieuce ol instructional actions taken 
bv tlie protiram vanes as a tunction ol a given student's' perlormance history, and 
i2} the program v. ^reani/ed to modify jlselt aiitoniatically as more students 
complete fh; course and their response records identify detects in instructional- 
stratemes 

Our w »rk Of. adaptive nistructuMial systemvlias ihree foci One is the develop- 
iHftft .tl a com-.e nt c MUpiitet proi'rannn.int! (or lunior coMege and college 
^^UvlenK. Mie .eonid is a c^Mirse hu teachiut' readmit m the lirst three grades of 
eiemenrarv scho<»is. jtul tlie third is a toreign-laimuage vocabulary program being 
used ar the c-llege level, Fleu* I will review research on each ot these projects. 

INSTRUCTION IN COMPUTER PROGRAMMING 

Our !irs( ftt'Tfs f«» i\u \\ . ompufcr progr:nninitm involved the development ot a 
computer r.si. led ifi-.iiuch'»M (( \|) rurncuhiin lo teach the All) (Algebraic 
hilt'iprerivi' Dial >gue) progiammntL* fanguai'e; this course has been used exten- 
■avelv n. l.oHeL»e^ a!id janior colleges a^ an nuroduction t'> cnmpiKer program- 
ming (Beard. 1 oit.^?;. Searlo. \tknvM>n. \'^^,'^). However, it is a linear. ^M'ranie- 

er|c '^^^ 
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[nubl ''.i!'. a<.ruK it^jli, Attor w^ukn^L' .thr^^UL'j! lv.s>nn scJinorits on 
^Uit.r\. .'xpi •■■ ■h ii-.. . . ill ' ;^ pi«>bk>fn solv.- in AID. Ho 

n\n>\ \h:h Ic iv rho i!f frtii.!iw'nl pr- ulhu, up a scpar.itv AH) intorprcier, 
portorni tliM:'vjan . <i prML'Mnniinii.' t;r,k..uid t--lniv\ (n Ui.' in .!!iKMional proiirani 
with an answ./i A > Ui'' \tiiiK*''t vviit^-* a [Mi "Mar!i with AH), llic'nilv sources ol 
assistaiK^.^ aro Mio ctuM nio>^a^'t'> pT"V»»lod \>\ tlio iiwiiinstructioiKil n}tci[)rctor. 

Aft ui.nioijti.icv ot thi' AID vourso, ospociail> U^r re>carvh purp^^sos, is its 
liiniKHl aMi'-: J « cliaraciof!/*/ iiuIivkIimI sUklonts* kiunvlcdgo o[ specific skills, 
arhi its jii.ilnitt'. r.-lat.' st!Kkvi»s' ,kill'. to ilio curriculum as any thing more than 
a ratio ..t pri.hlt ifK c^^ru'* ( prMhi^Mns atfoiUj^Kvl. 1 he [iro*.'rani cannot make 
tine ill>.t^^;tl^'n^ hctwc/f; i ■••r\v\ru{\ sUeinMlis aiKl weaknesses, and canniit 
prcNent ii: .tru. II' m1 iriatenal speciticallv appropriate to thai student beyond 
'*hatd»"i" ' t h r i --ssiMis 111 order to e\ploio the eflects ot different 
curru ulum > f^^n ^fMl ".'le , hi more detaik we devek^ped another introduc- 
i\n\ p?o.Marninin/ - li-.e, ^api^'ile ot lejirescntjUL!; both its suhject matter and. 
siudera prrtorm.ji'.. " niMP' :jii>-i|t!>tleiv I he mlemal representation of prograin- 
tmiiv ^kd^ afid fiien r fjh' ■!! Jiip , to flu curnculum is simikir in some way^^ to 
rb; .rmatittc T^-rvV^ !k> 'i-ed in fhe "I'v-rv/r.iuvc'' CAl programs develojied bv 
('ari^onoll and >ffjci .\i .irbi.n-lk pr^U. ( ^ CaibotK-il, Warnock, M^73) 

The BASIC l!v;trn(.tiniMl Program 

An imp'^'Ttatif teattiic ^1 a ttU^Tial CAI piogmni is to provide assistance as the 
NtiideiiJ iff'-mpis to ,M|ve i pr oblem Hie program must contain a representation 
ol the vibiort matter that js complex enouJL^h to allow the program to generate 
appropriate iw^c a\ anv staee o| tlic student's solution attempt. The BASIC 

{Bee.uuicr. Alkpuipov.- S\m}ii»he iTistrucnon Code) Instriicuonal Program (BIP) 
contains, a representation ot irif >rmat:i n appropriate to the teaching of com- 
puter pr-'tTjinnune tliat alk>ws the pn^iTram b'Uli to pr^^vide h;dp to the student 
afid im pfM 'tm t Imuted f^i! adnpiaf^' analvsis of \Uc corroctiiess ol the 
sludt'ftt's [II i.'f jrri I. a >t'hih.iTt r«> ?he L^ven problem. 

L» t.he -tudetit sealed at a tenTunal, BIP looks \vr\ much like a typical 
tnnc'shaniie BASIC opi ratii^ti s\.^tem. The BASIC interpreter, written especially 
b>f BlIV / ' . a., !) porei.im hne .liter the studeiit tvpes it, and notilies the 

>iud-, T!; i\ 'ih T . Wlien rlie ^tutlt-itl ruTti his or Iv/r juoirrani it is checked 

b^r struimnl illoLr.jhtje^, and diirnu! rinitime '\^\ecntion" errors are indicated. A 
tiK' -.tor ie,e svMern. i eaicula^'r, and utiht\ commands are available. 

U.-aibtiL' alv»v;' th ' anMifi("d op^-ialir-i^ Astem is the "tutor," or instructional 
pr«.vran» llPi If mIm^^K the 'i^tir/ Nindenf BIP dialogue and motivates the 
ii!Structi"nai inti^riK ti- ei In ad^Iitjon u^ .x-\ck.\iu^\ atul presenting pnreramming 
.problems ^ ^ tfi- sru-ienf. tl^e IP idetuifie^ tlie student's problem areas, suggests 
simpler 'N-dwa-k /^ i^iv -s hint , or model so;(utions when necessarv, ofters debiig- 
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dASiC rNTERPRETER 

'J,>rNra< AND ExE*:uT)ON 



PRO'iRAM ANALYZER 



f^ 'O 1 HIP itjf< Tin if I'Hi tlow tli.uTain 

mj. juJs, :aul Nupplies iiiLMdcntal insirucrinn m the [unn messages, interactive 
ItNsi'iis. «tr . manual r.eU'reiiees. 

At the core ut BIP i-. an mfijrmatuMi network wliose nodes are eoneepts. skills, 
pr«>biem^. subprohlems. prerecnusitcs. HASH' eonmiands. remedial lessons, hints, 
.iFul manual reterenees I'he network is usetl to eharaeten/e both the logical 
structure ot tlie course and our estimate ot the student's current state of 
kTttnvIedue. n^re will bo said .i^bout the network later. Figure 1 illustrates the 
interactiofis oi the parts of the BIP program. 

The\urnculum is orgarn/'ed as a set ol proiirannning problems whose text 
ir]i!u.,le> onlv the description o| the problem, not lengthy tleseriptions of 
pr^KiramnmiL' structures ox expianatioris uf svntax. There is nt) lixed ordering of 
the tasks; the tfecision to move from tuie task to antither is made m the basis of 
the mtnrniation about the tasks (skills involved, prerequisites, subtasks available) 
stored \\\ BIP , neiwoik 

A .fudant proLMVsse^ lhr(Hiidi the' eurrieuhim by writing, and running, a 
pr<vi'ram that solves the problem presentetl on the terminal. Virtually no limita- 
tions are imposed on the amiUJni of time the student spends, the number of lines 
fie wwU's, (he number tU errors he is al{v>wed to make, the number of times he 
thou^.e, ti..>xecute the pro^r uji. ric. I he (,isk on which the student i.s working is 
sti»rcd .uj a stack-like structure, so that he luav w<irk on an<uher task, for 
whatever reaMui. and return u> the previous task automatically. The curriculum 
structure can accommodate a wide vanetv of student aptitudes and skills. Most 



4 AUAPTIVF INSTRUCTIONAL SYSTEMS 85 



of the curriculum-related options arc designed with the less competent student 
in mind. A nuuo cnnipeteut student ma\ simply ignore the options. Thus> BIP 
gives student:^ the opporiunit) u* determine their own "challenge levels" by 
making assistance available but not inevitable. 

BIP oilers the student considerable Hexibihty in making tusk -related decisions. 
The student may ask tor hints and sublasks to help solve the given problem, or 
may ponder the pr(jblein» using only the manual tor additioivd information. The 
student mav rccjucst a dilTorent task by name either completing the new task or 
not, as "he or she chooses. On the student\s return to the original task. BIP tells 
him or her the name the iigain-current task, and prints the text of the task if 
requested. The student may request the model solution I'or any task at any time, 
but BIP will not print the model tor the current task unless the student has 
exhausted the available hints and subtasks. Taken together, the curriculum 
options allow tur a wide range .ol' student preferences and behaviors. 

The Information Nfftwork of BIP 

. Pask selection, remedial assistauLC, and problem area determination require that 
the program have a llexible nitormat-itm store interrelating tasks, hints, manual 
reterences', etc. This store has been built using the associative language LEAP, a 
SAIL (Stanford Artificial Inlelligence Laboratory ) sublanguage, in which set, list 
and ordered triple data structures are available (Feldnian, Low, Swiiiehart, & 
Taylor, l^ni: Swinhart Spmull. l^>7 1 ; Vanlxhn, IW). Figure 2 prcsents a 
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simplified relalHWiship anunii: a tew pmaraniniiiig concepts, ^pecilie ohservable 
skilN tli.w. characterize the acqui^i^^>n ui' tiie cuncept.s. and prograiHining prob- 
ieiii.v that lequii-' ihe Usc ^.f th^ »sc skills. The netvv nk is ci.Mistructcd using tlie 
.{s.xKfAtwv triple structure, afui u he>t vlvu'ribeJ iri .(rrnis of the various types of 
nod/N 

' " 
/ I ASKS All V iirih.uluin elements e\is(/as task nodes in the network, 
/ ^1J'-> are luiked to each otlie/ as suhtasks. prerequisite tasks, 

/ or •*mu>i follow" tasks, / 

r SKIM S: I he >kill nudes are mtermetliaries between the concept nodes 

and the task nodes (|-ig /^^). Skdls are very specific, e.g., 
"eiuicitenating string variiihlcs" or "increnienting a counicj 
variable." Bv evaluating Success on the individual skills, the 
piogram estimates comp^Otence levels in the ot)ncept areas. In 
flH' network, skills are i/elated to the [asks that require them 
ind lyi the concepts that embody them, 
f fie/principal contvpt areas covered by HIP are the following: 
n^vMaciive programs; variables and literals; expressions; input 
nd output. proMiiinl control branching; repetition loops; 
debui\u:ing. subioutin^S: ami arrays. 

kicli BASK^ 'jperation (PRIN r, UvT, . . . ) is a node in the 
netW(uk. The operaticnis are linked to the tasks in two ways; 
-Mfher as elements that must be used In the solution of the 
prohloni. in as tln»se. that must not be used in the solution. 

hint riMtles are fjnkeii to the tasks for which they may be 
h;lptul l',k:h tune aUew >kill, concept or BASIC operator is 
introduced, tlk-re is aji extra hint tluit gives a suitable nuinual 
lef^-Menee. \ 

All discoverLibk' >vntax, structural, and execution errors exisl-^ 
.IN !iodes in tlie netvvt^k. jinked to the relevant "help'' mes- 
sjge>. manna! rt'Ieienceiatul ri^niedial lessons. 

( h-Mfl. ill .i>nw »..iv:s. .1 liioriiKlu among skills nr problems is implicit; more 
^tr.queritiv . liowever. such a rehitionsiiip cannot lie assumed. By imposing only a 
\ T\ !».ov fiierarclrv (e.g.. requiriitg that ;dl students begin the course with the 
..nn<' pit>bf,-m). ti w p-usible fr» seK'cl cmnculum and provide assistiince on the 
h^i. 4 a Jiid, tif\ if rnonstijtt'd competence level i>n specific skills, rather than 
■>ti th. b.iM> t>i a prtHleternuncd, nomndividuah/ed. se(|ueiice of problems. 
Snitlenr-v wh" acquire eompotence in skills in smne manner other than thai 
a^,iimi'd l)v .abh'i i matu-r i'xp.'rt , ti -b^- standaril should betrelit most from this 
pt»f< tifjat t».r nuhvaduah/atton 

I pon ctunph'lion rA a (a.k, rh.- stud ent i. iuven a "post task interview" in 
whicl) BIP prcenr. tla- model st>lijtiori .ri^reil lor that problem. riie'stUilent is 
eTiLo.uraivd r>' reirard the mod.^l as onlv.one ol many possible solutions. iliP asks 
tlh; student wfi- ther lie or .he has v)]v\vi the probleuK then asks (lor each of the 
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skills a:>si)tiated with the task) whether more practice is needed on that skill. In 
addiliim ti) the information gained from this student seit-analysis, BIP also stores 
the result of a comparison between the student's program and the model 
solution, based on the output of botii programs when run on a set of test data. 
The student's responses to the interview and Ihc results of the program compari- 
son are used in future BlP-gcncrated curriculum decisions. lilP informs the 
student that the task has been completed, and either allows the student to select 
the next task by name (from an off-line printed list of names and problem 
texts), or makes the ^election for the student. 

An example of th^ role uf the Information Network in BIPs tutorial capabil- 
ities is the BIP-gencrated curriculum decisions mentioned above. By storing the 
student's own evaluation of his or her skills, and by comparing the student's 
solution, attempts to \hc stored models, BIP can be said to *1earn" about each 
student as an individual who h:is attained a eertain level of competence in the 
skilK associated with each task. For example, BIP might have recorded the fact 
that a given student had demonstrated competence (and confidence) in the skill 
of asstgnmg a literal vahie to a variable (c.g.,A'= I), but had failed to master the 
skilU)f incrementing a counter variable (e,g.,.V= 1). BIP can then search the 
network to locate the skills that are appropriate to each student's abilities and 
present tasks'that incorporate those skills. The network provides the base from 
which BIP can generate decisions that take into account both the subject matter 
and the student, behaving somewhat like a human tutor in presenting material 
that either corrects specific weaknesses or challenges and extends particular 
strengths, proceeding into as yet unencoiintered areas. 

The BIP program-has been running successfully with both junior college and 
university siudentv' Ilowever,"the program is still very much in an experimental 
stage. I'nnii a psychological viewpoint, the principal research issues deal with (1) 
procedures for obtaining on-line estimates of student abilities as represented in 
the information netwi^k, and (2) alternative methods for using the current 
estimates in the information network to make instructional decisions. Neither of 
ihcNC issuos is lestncicd to this particular course, and a major goal in the 
• development of BIP is to' provide an instructional model suitable to a variety of 
ditTerent subject areas. Two topics must be discussed in relation to this goal: the 
nature of appropriate subject areas and4lw general characteristics of the BIP-like 
stiucUire lhat makt^ iC particularly useful in teaching such .subjects. 

A ^llbK>c{ well suited to tins approach generally fits the following description: 
it has clearly definable, demonstrable skills, who.se relationships arc well knoWrr, 
(he real content of the sub)ect matter is of a problem-solving, rather than a 
iact-auciuiring, nature, tiie pn.hlems presented to the student involve overlapping 
st»ts ot skdls. and a sludont's soliiti.ui to a given problem can he judged as 
adequate or madccjuate with some degree of confidence. The BASK' language, as 
taught by BIP, is one sUch subject, byt the range of appropriate curriciilums goes 
well heviuid the area t)l computer science. For example, elementary statistics' 
' could ho taught by a similar approach, as could algebra, navigation, accounting. 
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or ^Tgjnic chemistry. All ^hc^c ^ihicc.t aieas \n\o\\v the niaiiipulation of iiifor- 
iw.iju^n h\ thJ student toward a kru)wn goah all nivnlvc processes that can be 
carrs-d .ui m; Minulalod h\ a c^'nipjtter. and all are based on a body of skills' 
whusc acquisition hv the student cafi be measured with au acceptable'degree of 
acctiracv * • 

Becau>>c tliev require the developmon? ot pii^blem-solvinij skills, rather than 
the memon/ation ot tacts, these subject areas are frequently ditficult to master 
and difficult ti) tutor, especially using^standard CAI techniques. One limitation 
«'( such standard tcchnu|ues is theff dependence on a *'right" answer to a given 
question or pi'ohlem, whkli precludes active studeitt participation in a problem- 
snlving process cnnsistinii of nianv steps, nunc of wluctr can be evaluated as 
correct or incorrect except witliui the context of the sdlution as a whole. In 
addition, standard (\AI techniques tjsnally consist of an instriictional facility 
ahuie • a niochanism by which mtorniation is presented and responses are judged. 
IU\^ iacihiv cm be iuiked tn a true problem-solving facility that allows the 
>tud''nt to piu.jced through the steps tu a solution, but the link does not allow 
tlie franstci "t ifiloimatiun b-tween the instruclional and the problem-solving 
porrjniis (>( the piM.-am. Ihc complete mtegratiou of tbe two parts is a key 
leature ui BIP. niakinii it appropn.ite to instruction in subject areas that have 
beo!» inade(iuatfl> treated in CAI. 

The mo>t gen';ra] cliaractcnstics of ibc 'MiotW(»rk" structure include a-represen- 
tation of the ciirrktilum in terms ot the specitic skills re([uired In its nuistcry and 
a representatnm i»t the student's current levels of conipetence in each of the 
skiilv he has beeti icquire'd to use. I luhvidiiar record-keeping relates each stu- 
dent's proiiicss to th.' curriculum at all times, and any number t^f schemes may 
be uv;d ju appiv that relatiorisjiip lo the selection of tasks or the presentation of 
additional intormation. lutifs. ,ii]vice, etc 

An nu[^ortan( element o\ our network structure is the absence of an cstab- 
hslied p.ith through tlie curriculum, providing tlie built-in tle.xibility (like that of 
.1 human tutor) to respond to individual students' strengths and weaknesses as 
• mJi studivrf wviks" With the CiUirso Mus can ouW be accomplisiicd through a 
var-tul at.alvwv and precise spceiticatiun o\ the skills inherent m the subject 
matter, the con>tMictu»n of .1 {liorouuh curriculum providing in-depth experience 
witli all the skiiis. and a structure of associations anumg elements of the 
. nrru ulum (h.it alh.us tnr the implemenlativui of various instructional strategies, 
in .(ru/fw.nai r1''\th,jif\ 1 M:..mplemented by research llexibility m such a struc- 
ture. be,.auv>.r|ie natuie.of jho asstic!.itic»ns can be nu^dilied foi different 
experimental purposes. Oiwc the elements of the network have been established, 
1! I'v ^'a-A, tor -x.mifilr. tn ehani^e (he prerequisite relaticuiship between two 
prubleni 01 !m spr, ,}\ J bu'lKT lev '1 o| competence in a given skill as a eriterion 

The .^''^.i.terable complexity involvui ut piOhTramtmn^ this kuuf of flexible 
srru.'ture unp^^scN .t certajn liniitanon St.indard "author languages" are not 
ippropn.ire u> ihi. ne^vt^rk .tppr.'.iclj, afid constjuctiim a CAI course {)n BIP's 
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pattern is not a task to be undertaken by the educator .(or researcher) who has 
no programming support. The usefuhiess of author languages is their simplicity, 
which allows subject-matter experts to prepare course material relatively quickly 
and easily. Most author languages provide for alternative paths through a 
curriculum, for alternative answer-matching schemes> and so forth; considerable 
complexity is certainly possible. However, the limits, once reached, are real, anfl 
the author simply cannot expand the sophistication of his course beyond those 
limits. - 

The programming support required by the network approach, on the other 
hand, implies (1) the use of a general, powerful language allowing access to all 
the capabilities of the computer itself> and (2) a programming group with the 
training and experience to make full use of the machine. It has been our 
experience that the flexibility of a general purpose language, while expensive in a 
numbe't of ways, is worth the costs by virtue of (he much greater freedom it 
allows in the construction of the curriculuni and the implementation of experi- 
mental conditions. For a more complete description of BIP and a review of our 
plans for further research see Barr, Beard, and Atkinson (1974). 

INSTRUCTION !N INITIAL READING 
(GRADES 1-3) 

Our first efforts to- teach reading under^ computer control were aimed at a total 
curriculum that would be virtually independent of the classroom teacher (Atkin- 
son, 1968). These early efforts proved reasonably successful, but it soon became 
apparent that the cost of such a program would be prohibitive if applied on a 
large-scale basis. Further, it was demonstrated that some aspects of instruction 
could be done very effectively using a computer, but that there were other tasks 
for 'which the computer did not have any advantages over classroom teaching. 
Thus, during the last four years, our orientation has changed and the goal now is 
to develop low-cost CAl that supplements classroom teaching and concentrates 
on those tasks in which individualization i.s critically important.-^ 

Reading Curriculum 

Reading instruction can be divided into two areas which have been referred to as 
''decoding" and "communication.'' Decoding is the rapid, it not automatic, 
association of phonemes or phoneme groups with their respective graphic repre- 

-A stmicnt icrmmal in (he current pr(i«rani consists only of aMcHiel-33 teletypewriter 
with an audio headset. There is no graphic i)r ^photographic eapability at the student 
terminal as there was in our first system, and the character set of the teletypewriter includes 
''only uppercase letters. On the i)thcr hand, the audio system is extremely flexible and 
provides virtually mstantane«ous access to any one of 6,000 recorded words and messages. 
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FIG. 3 Schematic presentation of the strand structure. In try into each .strand depends on a 
student's performance in earlier strands. The vertical dotted lines represent maximal rate 
contours which control the student's progress in each strand relative to the other strands. 



j?eiUations.v Communication involves reading for meaning, aesthetic enjoyment, 
eptphasis, and the like. Our CAl program provides instruction in both types of 
tasks, but focuses primarily on decoding. The pi !ram is divided into eight parts 
or strands. As indicated in Fig. 3, entry into a strand is determined by the 
student's level of achievement in the other strands. Instruction begins in Strand 
0, which teaches the skills required to interact with the program. Entry into the 
other strands is dependent on the student's performance in earlier strands. For 
example, the letter identification strand starts with a subset of letters used in the 
earliest sight words. When a student reaches a point in the letter identification 
strand where he has exhibited mastery over the letters used in the first words of 
the sight-word strand, the student enters that strand. Similarly, entry into the 
spelling-pattern strand and the phonics strand is controlled by the student's 
placement in the sight-word strand. On any given day, a student may be seeing 

^ exercises drawn from as many as five strands. The dotted vertical lines in Fig. 3 
represent ''maximal rate contours," which control the student's progress in each 
strand relative to progress in other strands. The rationale underlying these 
contours is that learning particular material in one strand facilitates learning in 
another strand; thus, the contours are constructed so that the student leprns 

^specific items from one strand in conjunction with specific items from other 
strands. 
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The CAI program is highly individuali/ed so that a trace through the curricu- 
lum is unique for each student. Our probiem is to specify how a given subject's 
response history should be used to make instructional decisions. The approach 
that we have adopted is to develop mathematical models for the acquisition of 
the various skills in the curriculum, and then use these models to specify optimal 
sequencing schemes. Basically, this approach is what has come to be known in 
the engineering literature as "optimal control theory," or, more simply, ''control 
theory.'' In the area of instruction, the system to be controlled i$ the human 
learner rather than a machine or group of industries. If a learning model can be 
specified, then methods of control theory cair be used to derive optimal 
instructional stratjegies. 

Some of the optimization proecdures will be reviewed later, but in order for 
the reader to have some idea o'f how the CAI progranri operates, let me. first 
describe a few of the simpler exercises used in Strands II, III, and IV. Strand II 
provides for the development of a sight-word vocabulary. Vocabulary items are 
presented in five exerci.se formats; only the eopy exercise and the recognition 
exereisc wiILb(? described here. The top panel of Table 1 illustriites the copy 
exerci.se, antl the lower panel illustrates the recognition exercise. Note that when 
a student jmakes an error, the system responds with an audio message and prints 



TABLE 1 

Examples of Two Exercises Used in Strand II 
(Sight-Word Recognition)^' 





Teletypewriter 


Audio 




display 


message 


Copy extircise 




Tlie program outputs 


PIN 


(Type pen.) 


Tilt student responds by typing 


PI'N 




Tlic program outputs 


+ 


(Great!) 


The program outputs 




(Type egg.) 


The student responds by 'typing 


ITI- 




'Hie program outputs 




(No, egg.) 


Recognition exercise 




'Hie program outputs 


PIN Nl-T KGC; 


(Type pen.) 


The student responds by typing 






Ihe pr^^gram outputs 


+ 




The program outputs 


PI-N EOG NET 


(Type net.) 


llic student responds by typing 


0 NKT 




The program outputs 


+ 


(I'abulous!) 



^Tlie top panel displays the copy exercise and the bottom the 
recognition exercise. Rows in the tiible cortespond to successive 
lines on tiie teletypewriter printout. 
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out the correct rcspi)nsc. In carlic> versions of (lie program, tlic student was 
required tu copy tlie eorreet response follownig an error. FxperinVent.s denion- 
strateil that the overt correelit)n procedure was not particularly effective; simply 
displa\iiig the Ciirrect word following an error providetl more useful feedback. 

'Strand Hi offers practice with spelling patterns and cmphasi/es the regular 
grapheme phoneme correspondences that exist in f-nglish. Table 2 illustrates 
exercises from this strand. Ft)r the exercise in the top panel of Table 2,- the 
student. is presented with three words invt)lving the same spelling pattCJrn and is 
required to select the correct one based on its initial letters. Once the student 
has learned to use the initial letter or letter sequence [o distinguish between 
Winds, he moves to the recall exercise illustrated in the bo{[a}\ panel t)f Table 2. 
Here the student works with a group of words, all' invtdving the same spelling 
pattern. On each trial, the audio system requests a word that requires adding an 
initial consonant or consonant clustef to the spelling pattern mastered in the 
preceding exercise. Whenever a student makes a correct resptinse, a *'-H''sign is 
printed on the teletypewriter. In addituin, every sti often the program will give 
an audit) feetlback message; these messages vary Worn simple tines like *'great " 
"that's fabulous;' '\vou're doing brilliantly /' to some that have cheering, clap- 
ping, or bells ringing in the backgiound. These messages are not generated at 
randtmi. but depend on the sludeiitN perftirmance on that particular day. 

When, the student has mastered a specified number of words in the sight-word 
stjand, lie or she begins exercises in the phonics strand; this strand concentrates 
on initial and final constmants ami consonant clusters in combination with 
medial vowels. As m nuist linguistically t)rientated curricula, students arc not 
required to rehearse or identify consonant stiunds in isolation. The cinphasis is 
on paifeiiis of vowels and consonants that bear regular correspondences to 

TABLE 2 ! 
Fx >rT>pIf?5 nf thfj Rocoqnitfon ami Rfjcjil ExiHcisGS Usodim 
Str.inU III (Sneihnn Puttorns) 



rek'typewritcr ^Audiu 
displ.iy jiK'ssa^^Q 



Ilu- pnn^Mm owiputs KI PI SI.l-PT ( R\ V\ (Tyfjc kept.) 

1 h.o student rospoiuis l)V tvpjm^ K| Pl 
Ihe proiiram outputs f 



ERIC 



Recall excrdse 

The prin'ram outputs (Type crept.) 
The student responds by tv pin^ ( Rf P I" 

The proirrain outputs + cniat's- fabulous!) 
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TABLE 3 

Examples of Two Exercises from Strand IV (Phonics) 





Teletypewriter 


Audio 




display 


message 

„ ^ 


Recognition exercise 




The program outputs 


-IN -IT -IG 


( 1 ype /iCj/ as m iigj 


The student responds by typing 


IG 




riie program outputs 


+ 


tLjOOu; ; 


The program outputs 


-IT "IN IG 


11>PC / II / as III III.; 


Tlie student responds by typing 


IT 




Tlie program outputs 


+ 




0 Build-a-word exercise 




The program outputs 


-IN --IT 






P - - 


(Type pin.) 


The student responds by typing 


PIN 




The program outputs 


^• 


(Great!) 


The program outputs 


- IG IN -IT 






F - 


(Type fig.) 


The student responds by typing 


FIN 




Tlie program outputs 


IIIIVIG 


(No, we wanted. fig.) 



phonemes. The phonic strand is the most complicated one of the group and 
involves eight exercise formats; two of the formats will be described here. The 
upper panel of Table 3 illustrates an exercise in which the student is required to 
identify the graphic representation of phonemes occuring at the end of words. 
Each trial* begins with an audio presentation of a word that includes the 
phonemes, and the student is asked to identify the graphic representation. After 
mastering this exercise the student fs transferred to the exercise ilUistrated in the 
bottom panel of Table 3. The ^same phonemes are presented, but now the 
student is required to construct words by adding appropriate consonants. 

^ Optimal Sequences for Individual Students 

This, has been a brief overview of some of the exercises used in the curriculum; a 
more detailed account of the program can be found in Atkinson, Fletcher, 
Lindsay, Campbell, and Barr (1973). The key to the curriculum is the optimiza- 
tion schemes that control the sequencing of the exercises; these schemes can be 
classified at three levels. One IcvqI involves decision making within each strand. 
The. problem is to decide which items to present for study, which exercise 
formats to present them in,- and when to schedule review. A complete response 
history exists for each student, ./and this history is used to make trial-by-trial 

• ■ / 
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declsiDus regarding what [a piL-SLMit next. The second level of Dptinii/atioii deals 
with decisions about allocation of inskuctional time among strands for a given 
student. At tlie end of an instructional session, the student will have reached a 
certain point m each strand and a decision must be made about the lime to be 
allocated to each strand in the next session. I'lie third level of optimization deals 
with the distribution of instruciiona! time among students. The question here is 
to allocate computer time among students to achieve instructional bbjectives 
tliat are defnied not for the mdividual student but for the class as a whole. In 
some global sense, these three levels of optimization should be integrated into a 
unified program. However, we have been satisHed to work with each separately, 
brpmg that later they can be inct)rporated into a single package. 

Optiim/ation within a strand (what has been called Level 'l) can be illustrated 
using the sight-word strand; The strarid comprises a list of about 1,000 words; 
the words are ordi^red in terms of the'ir frequency in the student's vocabulary, 
and words at the bcguming of the list have highly regular grapheme-phoneme 
correspondences. At any point in time 'a student will be. working on a limited 
pool of words from the master list; the size of this working pool depends on the 
student^ ability level luA is usually between 5 and 10 words. When one of these 
words is mastered, it is deleted from the pool and replaced by the next word on 
the list or by. a word due for review. FMgurc 4 presents a flow chart for the 
strand, hach word in the working pool is in one of five. possible instructional 
states. A trial involves sampling a word from the working pool and presenting it 
in an appropriate' exercise format. The student is pretested on a word the fiYst 
lew times ft is presented to eliminate words already known. If the student knows 
the word it will be dropped Iron: the working pool. If not. the student first 
studies the word using the recognition exercise. If review is required, the student 
studies the word again in what is designated in Fi^g, 4 as Hxerciscs 4 and 5. 

As indicated in Fig. 4. a given word passes from one state to the next when it 
reaches criterion^ And this presents the crux of the optimization problem, which 
is tt) define an appropriate criterion for each exercise. This has been done using 
simple mathematical models U) describe the acquisition process for each exercise 
and the transfer functions .that hold bctwceii exercises (Atkinson & Paulson, 
1^)72). These models are snnple Markov processes that provide reasonably 
accuiate accounts of pcrfiumance on our tasks. Pararncters of the models arc 
defhied as functions of two factors; ( 1 ) the ability of the particular student and 
(2) thc difhculty i)f the particular word. An estimate of the studefit's ability is 
obtained l)y analyzing his or her respiMise record on all previous words, and an 
estimate of a word's difficulty is obtained by analyzing performance o(,i that 



FIG. 4 RirtLiI flow dur} fnr Slrjiul II «si-ltj-\v<»nl nnMnmitlon). t he various tlcciKions 
rcprcscntL'U in the bn{t<.m pAvi oJ' IIk- Uiarl .jrc based on lairly L-ornpIiratod computalions 
lhal make use of fho vtuUcnt's response history. I he same rce()«.'niti(ni exercise is used in 
both state .V, and S). . v 




Enter 
strand, 
iniUate time 
in strand 
. clock . 



Transfer into working pool 
words that were m us^ 
when student was last in 
strand 



Student 

Sign-off 
coutine 



Exit 
to next 
strand 



Is ^ 
workmg 
pool 
futP 



I" 



y Has ' 
' time elapsed 
(or today's 
N session? 



I" 



Add new word or word ! 
Irom review pool to 
working pool 



Has - 
time elapsed 
for Gtrand' 



Sampte one word 
from ttie working 
pool and note its 
state 



State ■ 



Present 
word in 
ExerCiSP 1 
iPrfjtesO 



Passed 
'tnteriDn 



Update state 
of word to 



|)Hftp word 
' fropi worktnq 
pool 



Present 
word in 
Exercise 2 

(Copy) 



Passffd 
criterion 



' Mpdatp state 
of word to 



Present 
word in 
Exercise 3 
(Recognition) 



no Passed 
( ritcrion 



Present i 

word in | 

Exercise 4 \ 

(Copy) 1 



Sf^ould word 
be reviewed' 



i|yes 

Transfer word 
to review poo' ^- 
and updale 
stale of word, to S. 



Passed 
criterion ' 

I yes 

Update sUte 
of word to 



Delete word 
from working 
pool 



Present 
word in 
Exercise 5 
(Recognition) 



no /^Passed 



.criterion/ 



Delete word | 
from working ! 
pool j 



FIG, 4 
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particular word for all .studonts run on the program. The student records are 
continually updated by the computer and are used to compute a maximum 
likelihood estimate of each student's ability factor and each word's difficulty 
factor. Given- a well-defined model and estimates of its parameters, we can use 
the methods of control theory to define an optimal criterion for each exercise. 
The criterion will vary depending on the difficulty of the item, the student's 
ability level, and the precise sequence of correct and incorrect responses made 
by the student to the item. It is important to realize that tli^ optimization 
scheme is not a simple branching program based on the student's last response, 
but depends in a complicated way on the student's complete response history. 

Optimization between strands (what has been called Level II) was mentioned 
earlier in the description of maximum-rate contours. Tn some respects this 
optimization program is the most interesting of the group, but it cannot be 
. explained without going into considerable mathematical detail. In essence, a 
learning model is developed that spt^cifies the learning rate on each strand as a 
function of the amount of material that has been mastered in each of the other 
strands. Using mathematical methods of control theory, an optimal instructional 
.strategy is determined based on the model. This strategy defines a closed-loop 
feedback controller that specifies daily instructional allocations for each strand 
based on the best current estimate of how much the student has mastered in 
each strand. Aniiccount of the thetiretical rationale for th.e progranfWs presented 
in Chant and Atkin.son (1973). 

Optimizing Class Performance 

Next let us consider an example of optimization at what has been called Level 
in. The effectiveness of the CAP program can be increased by optimally 
allocating instructional time among, students. Supptisc that a school has bud- 
geted a fixed amount of time for CAI and must decide how to allocate that time 
among a cla.ss of first-grade students. For this example, maximizing the effective- 
ness^ of the CAI program will be interpreted as meaning that we want to 
maximize the cla.ss performance on a standardized reading test administered at 
the end of the first grade. 

On the basis of prior studies, the ftilKiwing equation has been developed to 
predict performance on a standardized reading test as a function of the time a 
student spends on the CM system: 

P{t:i) = A(i)-B{l)cxpl-tC{i)]r 

The equation predicts Student i's performance on a standardized test as a. 
function of the time. /, spent on the CAI .system during the school year. The 
parameters /!(/). Bdh and C{i) characterize Student /, and vary from one student 
to another. These parameters can be estimated from scores on reading readiness 
tests and from the student's performance during his first hour of CAI.. After 
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estimates of these panimeters luive been made, the above equation can be used 
to prediet end-of-year test seorcs as.a funetion of the CAI time allocated to that 
' student. 

Let us suppose that u school has budg^^d a fbted amount of time T on the 
CAI system for a first-grade class of N students; further, suppose that students 
have had readnig readiness tests and a preliminary run on the CAI system so that 
estimates of (he parameters k. B, and C have been made for each student. The 
problem then is to allolcate time T among the 'N students so as to optimize 
learning, in order to do this, it is first necessary to have a model of the learning 
process. Although the above equation does not offer a very detailed account of 
learning, it suffices as a model, for purposes of this probfem. This is an important 
point to keep in i-^ind; the nature of the specific optimization problem deter- 
mines the level of complexity that needs to be r^.pre^ented in the learfiing model. 
For some i)ptimi/ation problems, the model must provide a relatively detailed 
account, of learning to specify a viable strategy, but for other problems a simple 
descriptive equation may sufnee, 

3 hC addition to a model of the learning process, we must als6 specify an 
instructional objective. Only three possible objectives will be considered here: 

I, Maximize the mean value of? over the class of students, 
11. Minimize the variance of P over the class of students. 
HI. Maximize the mean value of P under the constraint that the resulting 
. variance oiP is less than or equal to the variance that would be obtained if 
no CAI were administered. 

Objective I nuLximizes the gain for the class as a whole: Objective 11 reduces 
differences among students by making the class as homogeneous as possible: and 
Objective 111 attempts to maximize the class performance while insuring that 
differences among students are,no| amplified by CAI. If we select Objective I as 
the instruetionar objective, then the problem of deriving an optimal strategy 
reduces to maximi/ing the function: 



where /{/) is ihc time allocated to Student /, This maximization can be done 
using the methods'of dynamic programming. To illustrate the approach, compu- 
lations were made for a first-grade class for which the parameters and C 
had been estimated for each strident. Hmploying these estimates, computiitions 
were carried out to determine the tinie allocations that maximized the above 
equation'. For the optimal policy, the predicted mean performance level of the 
class on\the end-of-ycar tests was 140' higher than a policy that allocatecl' time 
equally «4Unong students (i.e„ an equal-time policy, where t(i) = T/N for iill /). 



./[/(l),/{2) /{A-)l =E{>l(0-/i(/)exp[-r(/)a/) ]f, 



r(l) + rf2)+ ••• +/(AO = r, 
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^ TABLE 4 
Predicted Percent Gain in the Mean of /'and 
ii the Variance of/'\Vlien Compared with tlie 
Mean and Variance of the Fqual-Time^Policy 





Inslruclional objective 




• i a ill 


Gain in mean o^PV.l) 


14 -15 8 


Gain in variance o(P (%) 

: ; — , 


15 -12 -6 



This gain represents a substantial improvement; the drawback is that the class 
variance is roughly 15% greater than the variance for the class using an equal- 
time policy. This means that if we are only interested in raising the class average, 
we will have to give the rapid learners substantially more time on the CAI system' 
arid let them progress far beyond thcrslow learners. 

Although a time allocation that complies with Objective I does increase overall 
class performance, other objectives need to be considered. For comparison, time 
allocations also were computed for Objectives 11 and III. Table 4 presents the 
predicted gain in average class performance as a percentage of the mean value for 
the equal-time policy. Objective II yielded a negative gain in the mean; and so it 
slrould, since its goal was to minimize variability, which is accomplished by 
reducing the time allocations for rapid learners and giving more atteiitioji to the 
slower ones. The reduction in variability for Objective 11 is 12%. Objective !II, 
which strikes a balance between Objective I and Objective II, yields an S% gain 
in mean performance yet reduces variability by 6%. . 

In view of these results, Objective III would be preferred by most educators 
andjaymen. It offers a substantial increase hi average performance while main- 
taining a low level of variability. These computations make it clear that , the 
selection of an instructional objective should not be done in isolation but should 
involve a comparative analysis of several objectives, taking into account more 
than one dimension of performance. Even if the principal goal is fo maximize 
the cla.ss average, it is inappropriate . in most educational situations to select 
Objective I over- III if it is only slightly better for the class average, .while 
permitting variability to mushroom.'^ 

Effectiveness of the Reading Program 

Several cvaluatioji studies of the reading program have been conducted in the 
last few years. Rather than review these here. 1 would prefer to describe one in 
some detail (Fletcher & Atkinson, 1972). In this particular study, 50 pairs of 

M-or a more detailed discussion of some of the issue involved in selecting objective 
functions see.Jamison, i-lctcher, Suppcs, and Atkinson (1975). 



]' 4. ADAPTIVE INSTRUCTIONAL SYSTEM^ '99 

'j ■ 

kindergarten students were mafched on a number of variables^ including sex and 
readiness scores. At tlie staFt of the first grade, one member of each pair was 
assigned to the experimental group and tlie other to tlie control group. Students 
in the experimental group received CAI, but only during the first grade; students 
in \he control group received no CAI. The CAI lasted approximately 15 min per 
day**; during this period the control group studied reading in the classroom. 
Except for this 15 min period, the school day for the CAI group was like that of 
the control group. Standardized tests were administered at the end of the first 
grade- and again at the end of the second grade. All the tests showed roughly the 
same pattern of results; to summarize the findings, only, data from the California 
Cooperative Primary Reading Test will be described At the end of the" first 
grade, the experimental group showed a.5.05-mont]i gain over the coaitrol group. 
The groups, when tested a year later (with no intervening CAI treatment), 
showed a difference of 4.90 months. Thus, the initial difference observed 
following one year of CAI was maintained, although not amplified, during the 
second year when no CAI 'was administered to either group. 

.No definitive pnclusions can be drawn from evahiation studies of this sort 
about the specific contributions of CAI versus other aspects of the situation. 
Obviously the curriculum materials used in the CAI program are important, as 
well as other factors. To do thp type of study that would isolate the important 
variables is too large an undertaking t ) be worthwhile at this juncture in the 
development of the reading program. Thus, to some extent it is a matter of 
•judgment in deciding which variables account for the differences observed in the 
above study. In my view, individualizing instruction is the key factor in success- 
fully teaching reading. This does not mean that all phases of instruction should 
be individualized, but certain skills' can be mastered only if instruction is 
sensitive to the student's particular difficulties:: A ^reading teacher interacting on 
a one-to-one basis with a student may be more effective than our CAI program. 
However, when working with a group of children (even as few as four or five), it 
is unlikely that the teacher can match the computer's effectiveness in making 
ins.tructional decisions ovor-an extended period of time. 

SECOND-LANGUAGE VOCABULARY LEARNING 

In this section, research on CAI programs for second-language vocabulary learn- 
ing will be discusse,4. As noted elsewhere in this chapter, the principal goal of 
our research on computerized instruction has been to develop adaptive teaching 
procedures-^- procedures that make moment-by-moment decisions about which 
instructional action should be taken next based on the student's unique respons^e 
.history. To help guide the theoretical aspects of this work, some years ago we 

^In this, study no attempt was made to alloca'c Jme optimally among students in tlie 
experimental grAip; raUier, an equal-time policy wa > employed. 
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= initiated a series of experiments on the very restrirtcd but we 11 -de fined .problem 
of optimizing the teaching of a foreign-hmguage vocabulary. This is an . area 
where mathematical models provide an accurate description , of learning,%nd 
these models can be used in conjunction with the methods of control theory to 
derive precise algorithms for sequencing instruction among vocabulary items. 
Although our original interest lin, this topic was prim;mly theoretical, the work 
has proved to have significant practical applications. These ^applications involve 
computerized vocabulary learning programs designed to supplement college-level 
courses in second-language instruction. A particularly interesting effort involves 

^ acsupplementary Russian program in use at Stanford University. Students are 
exposed to approximately 1,000 words per academic quarfer using the com- 
puter; in conjunction with normal classroom work this program enables^'them to 
develop a substantial vocabulary ,\Many foreign-language instructors believe that 
the major obstacle to successful instruction in a second language is not learning 
the grammar of the language, but rather in acquiring a sufficient vocabulary so 
that the student can engage in meaningfyl conversations arid read materials other 

.than the lex tbouk. 

In examining the work on vocabulary acquisition 1 will not describe the CAI 
programs, but will review some research on optimal sequencing schemes that 
provide the theoretical rationale for the programs. It will be useiul to describe 
one experiment in some detail before considering more general issues. 

An Experiment on Optimal Sequencing Schemes 

In this study a large set of German-English items are to be learned during an 
instructional session that involves a series of trials. On each trial, one of the 
German words is presented and the sttident attempts to give the English 
translation: the correct translation is then presented' for a bjief study period. A 
predetermined number of trials is allocated for the instructional session, and 
after some intervening period a test is administered' over the entire vocabulary. 
Tlje problem is to specify a strategy for presenting items during the instructional . 
session so that performance on the delayed test will be mjiximized. / 

Four strategies for sequencing the instructional materiai will be considered. 
The random-order strategy, (RO), is to cycle through the set of items randomly; 
this itrategy is not expected to be particularly effective, but it provides a 
benchmark against which to evaluate other procedures. The self-selection 
strategy (SS). is to let tlie student determine how best to sequence the material. 
In this mode, the student decides on each trial which item is to be presented; the • 
Jearner rather than an external controller determines the sequence of instruction. 

Micsc CAI vocabuhiry progrums make use of optimal sequencing svhenfes of the sort to 
be discussed in this section, as well as pertain mnemonic aids. For a discussion of these 
mnemonic aids sec Raugh and Atkinson ( ^975) and Atkinson and Raugii (1975). 

\ . ■ 
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The third and fourth schemes are based on a decision-theoretic analysis of the 
task. A mathematical model that^^ provides an accurate account of vocabulary 
acquisition is assunicd to hold in the present situation. The model is used to 
compute, on a trial-by-trial basis, an individual student's current state of learn- 
ing. Bast J on these computations, items are selected for test and study so as to 
optimi/e the level of learning achieved at the termination of the instructional 
session. Two optimization strategies derived from this type of analysis will be 
examined. In one onse, the computations for determining an optimal strategy are 
carried out* assjjming that all vocabulary items are of equal difficulty; this 
strategy is designated OE (i.e., optinfiaPunder the assumptioii of equal item 
difficulty). In the other case, the computations take into account variations in 
difficulty level among items; this strategy is called OU (i.e., optimal under the 
assumption of unequal item difficulty). The details of these two strategies will 
be described Jatcr. 

The experiment was carried out under computer control; the details of the 
experimental procedure are given in Atkinson (1972b). The students partici- 
pated in two sessions: an "instructional session" of approximately two hours 
and a briefer "delayed-test session'\administered one week later. The delayed 
test was the same for all students a.ud involved a test over the entire vocabulary. 
The instructional session was more complicated. The vocabulary items werg 
divided into seven lists, each containing 12 German words; the seven lists were 
arranged in a round-robin order. On each trial of the instructional session a list 
was displayed on a projection screen, and the student inspected it for a brief 
period of time; the list involved only the 12 German \vords and not their English 
translations. Then one of the items on the list was selected for test and study^ In 
the RO, OE. and OU conditions the item was selected by the computer; in the 
SS conditiorvjthe item was chosen by the student. After an item was selected for. 
test, the student . attempted to provide a translation by typing it on the computer 
console; then feedback regarding the correct translation was given. The next trial 
began with the computer displaying the next list in the round robin, and the 
same procedure was repeated. The instructional session continued in this fashion 
for 336 trials. 

The results of the experiment are summarized in Fig. 5. Data are presented on 
the left side of the figure for performance on successive^'Wocks of trials during 
the instructional session; on the right are results from the test session adminis- 
*'tered one week after the instructional session. The data from the instructional 
.session are presented in successive blocks of 84 trials; for the RO contrition this 
means that on the average each item was presented once in each of these blocks. 
Note that performance during; the instructional session is best for the RO 
condition, next* best for the OE condition which is slightly better than the SS 
condition, and poorest for the OU condition' The order of the groups is reversed 
on the delayed test. (Two points are displayed in the figure for the delayed test 
to indicate that the test involved two random cycles through the entire vocabu- 
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FIG. 5 Proportion of correct responses in successive trial blocks during the instructional 
session and on the delayed test administered one week later. 

lary; however, the values given are the average over the two test cycles.) The QU 
condition is best with a correct response probability of .79; the SS condition is 
next with .58; the OE condition follows closely at .54. and the RO condition is 
poorest at .\8. The observed pattern of results is what one would ©xpect. In the 
SS condition, the students are trying to test themselves on items they do not 
know; consequently, during the instructional session, they should have a lower 
proportion of„corre\:t responses than students run on the RO procedure where' 
items are tested at random. Similarly, the OE and OU conditions involve a 
procedure th>it|ttempts to identify and test those items that have not yet been 
mastered and .should produce high error rates during the instructional session. 
The ordering of groups on the delayed test is reversed since all words are tested * 
in- a nonselective fashion; under these conditions the proportion of correct 
responses provides a measure of a student's true mastery of the total set of 
vocabulary items. 

The magnitude uf the efiects observed on the delayed 'test are of practical 
significance. The SS condition (when compare'd to the RO condition) leads to a 
relative' gain of 53%, whereas the OU condition yields a relative gain of 108%. It 
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is interesting that students were scnnewhat effective in determining iin optimal 
study sequence, but iu)t so effective as the best of the two adaptive teaching 
systems, * 

Rationale for Sequencing Scheme 

Both the OU and OE schemes assume that vocabulary learning can be described 
by a fairly simple mt)del. We pt)stuhite that a given item is in one nf three states 
(F, r, and if) at :my moment in time. If tlie item is in Stated, then its translation 
is known and this knowledge is "relatively" permanent in the sense that tlie 
learning of other items will not interfere with it. If the item is in State 7, then it 
*is also known but on a "temporary" basis; in State 7 the learning t)f t)ther items 
can give rise to interference effects that cause the item to be ft)rgotten. In State 
{/the item is not kiumiu and the student is unable to give a translatitin. 

When Item i is presented on a trial during the instructitinal session, the 
fi)Ik)Wii^g transition matrix describes the ptissible change in its state: 

P T U 

P 

U 

Rows, of the matrix represent the state of the item at the start of the trial, and 
columns the state at the end of the trial. On a trial when some item other than 
Item / is presented f(^r test aiid'study, transititins in the state of Item /'also may 
take place. Such transitions can occur only if the student makes an error -to the 
other item: in tluit case the tran.sititm matjix applied io Item / is as follows: 

FT U 

'l 0 0" 

0 1 J\i) . 

0 0 1_ 

Basically, the idea is that when some other item is ppesented tluit the student 
does ncU know, forgetting may occur f(ir Item / if it is in State T. 

To summarize, when Item / is. presented Ibr test and study, transition matrix 
U/) is applied: when some other item is presented that elicits an error, matrix 
F(/) is applied, it is als(i assumed that at the start t)f the instructional session 
Item i is cither in State P, with probability or in State U, with probability 1 
- g(i)\ the student either knows the translation without having studied the item 
or doesMUit. The above "assumptions provide a complete description of the 
learning proce,ss. The parameter vector [xd). yd), z(i)J\i). g(i)] characterizes 



1 0 0 
x{i) l~.v(/) 0. 
v(/) z(i) 1 ' y(i) -z{i) 



P'l 

F(/) = r 

U 
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the learning of Item / in the vucabuhir>' set. The Hrst three parameters govern the 
acquisition process; the next parameter, forgetting: and the last, the student's 
knowledge prior to entering the experiment. 

We now turn to a discussion of how the OH and OU pnicedures were derived 
from the model. Prior to conducting the experiment reptirtcd here, a pilot study 
was run using the same word- lists and the RO procedure described above. Data 
from the pilot study were empk>yed to estimate the parameters of the model; 
the estimates were obtained using the minimum' chi-square procedures described 
in Atkinson (1972b). Two separate estimates of parameters were made. In one 
case it was assumed that the items were all equally difficult, and data from all 84 
items were lumped tt)gether to obtain a single estimate of the parameter vector; 
this estimation procedure will be called the equal-parameter case (/:' case). In thq 
second case the data were separated by items, and an estimate of the parameter'^ 
vector was made for each t)f the 84 items; ^this procedure will be called the 
unequal-parameter case (U case). The two se ts of parameter estimates were the'n 
used to generate the t)ptimi/ation schemes previtiusly referred tti'as the OE and 
OU procedures. . - 

In order to ft)rmulatc an instructional strategy, it is necessary to be precise 
about the quantity tt) be maximized, Ftir the present experiment the goal is to 
maximi/c the total number of items the student correctly translates on the 
delayed tcst.^* To do liiis, we need to specify the relationship between the state 
of learning at the end of the instructional session and performance on die 
delayed test. The a§sumptit)n made here is that only those items in State P at the 
end of\.the instructional session will be translated correctly' on the delayed test; 
an item in State T is presumed to be forgotten during the intervening week. 
Thus, the problem of maximizing delayed-test performance involves maximizing 
die number of items in State Pat the end of die instructional session. 

Having numerical values for parameters and knowing a student's response 
history, it is possible to estimate the student's current state of learning.'^ Stated ' 

''Olher measures caii be used io jsscss the benefits of an iiistnu-litinal strategy; for 
example, in this case weigh Is could be assigned Lo items measuring their relative importance. 
Also ct>sts nra^' be associated with the various actions taken during un instructional session. 
^Thus, tor the general case, the optimization, problem involves assessing costs and benefits 
and finding a strategy that maximizes, an appropriate function defined on them, por a 
discussion ot these points see Dear, Silberman. Hstavan, and Atkinson (1967), ;in4 Sniall- 
woudr I%2, 1971). \ , 

'The sMuient\ ''response history^'is a record for each trial of the vocabulary item 
, presenter! and tlu response that occurred, ft can be shown that there exists a ''sufficient . 
history" that contains tmly the information necessary to estimate the stydentN rurrent state 
learning: the sufficient history |s a function of the etmiplcte history and the assumed 
learning model ((iroen .'V'lkinson, 1966). I-or the model considered in this paper the 
sufficient hist(»ry is fairly simple. It is specified in terms of individual vocabulary items for 
• each student; we nbed to know, the ordered sequence ot correct and incorrect re^sponses to a 
given Item plus the number of errors (to other items) that intervene between each 
presentationof the Item, 
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more precisely, the learning model can be used to derive equations and, in turn, 
compute the probabilities of being in States P, and U for each item at the 
start of any trial, conditionalized on the student's response history up to that 
trial.- Given numerical estimates of these probabilities, a strategy for optimizing 
performance is to select that item for presentation that has the greatest proba- 
bility of moving into State P. This strategy has been termed the one-stage 
optimization procedure because it looks ahead one trial in making decisions. The 
true optimal policy (i.e., an A^-stage procedure) would consider all possible 
item-response sequences for the remaining trials and select the next item so as to 
maximize the number of items in State P at the termination of the instruc- 
tional session. Unfortunately, for the present case the A^-stage policy cannot be 
applied because the computations are too time consuming even for a large 
computer. Monte Carlo studies indicate that the one-stage policy is a good 
approximation to the optimal strategy; it was for this reason, as well as the 
relative ease of computing, that the one-stage procedure was employed. For a 
discussion of one»stage and A^-stage policies and Monte Carlo studies comparing 
them see Groen and Atkinson (1966), Calfee (1970), and Laubsch (1970), 

The optimization procedure described above was implemented on the com- 
puter and permitted decisions to be made for each student on a trial-by-trial 
basis. For students in the OE group, the computations were carried out using the 
five parameter values estimated under the assumption of homogeneous items 
{E case); for students in the OU group the computations were based on the 420 
parameter values estimated under the assumption of heterogeneous items {U 
case). 

The OU procedure is sensitive to interitem differences and consequently 
generates a more effective optimization strategy than the OE procedure. The OE 
procedure, however, is almost as effective as having the student make hj^s own 
instructional decisions and far superior to a random presentation scheme. 
' The study reported Uere is one in a series of experiments dealing with optimal 
sequencing schemes. It was selecjed- because it is easily described and- permits 
direct comparison between a learner-controlled procedure versus procedures 
based on a decision-theoretic analysis. For a review of other studies similar to 
the one reported above see Chiang (1974), Delaney (1973), Laubsch (1970), 
Kimball (1973), Paulson (1973), and Atkinson and Paulson (1972), Some of 
these studies examine procedures that are more powerful than the ones de- 
scribed here, but they are complicated and difficult to describe without going 
into mathematical detail. The major improvements involve two factors: (1) 
methods for estimating the model's parameters during the course of instruction, 
and (2) more sophisticated ways of interpreting the parameters of the model to 
take account of both differences among students and differences among items. 
For example, let Pii, j) be a generic symbol for a parameter vector characterizing 
student / learning vocabulary item /. In these studies P{i, j) is specified as a 
function of a vector A{i) measuring the ability of student ; and a vector /)(/) 
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measuring the dilTiculty of item /. The problem then is to estimate the ability 
level of each student and the difficulty of each item while the student is running 
on the program. In a study reported in Atkinson and Paulson (1972). rather 
dramatic results were obtained using such a procedure. A special feature of the 
study was that students were run in successive groups, each starting after the 
prior group had completed the experiment. As would be expected, the overall 
gains increased from one group [o the next. The reason is that for the first group 
of stuaents the estimates of item difficulty, /)(/'), were crude but improved with 
the accumulation of data from each successive wave of students. Near the end of 
the study estimates of /;(/*) were quite precise and were essentially constants in 
the system. The only task that remained when a new student came on the 
system was to estimate that is, the parameters characterizing his particular 
ability level. This study provides an example of an adaptive instructional system 
that meets both' of the requirements stated earlier in this chapter. The sequenc- 
ing of instruction varies as a function of each student's history record, and over 
time the system improved in efficiency by using data from previous students to 
sharpen its esinnates of the difficulty of instructional materials/ 



CONCLUDING REMARKS 

The projects described in this chapter have one theme in common, namely, 
developing computer-controlled procedures for optimizing the instructional pro- 
cess. For several of the instructional tasks con.sidered here, mathematical models 
of the learning process were formulated which made i1 possible to use formal 
tncthods in deriving opfimal policies. In other causes the *\)ptinKil schemes" were 
not optimal in m well-defined sense, but were based on our intuitions about 
learning and some relevant experiments. In a sense, the diversity represented in 
these examples corresponds to the stale of the art in the field of instructional 
design. For some tasks we can use psychological theory to help define t)plimar 
procedures; for others our intuitions, nuidified by experiments, must guide the 
effort. lh)pefully, our understanding., of these matters will incrca.se as more 
projects are undertaken to develop sophisticated instructional procedures. 

Some have argued that any attempt to devise optimal strategies is doomed to 
failure, and that the learner is i\\c best judge of appropriate instructional actions. 1 
am not sympathetic to a learner-controlled approach to instruction, because I. 
believe its advocates are' trying to avoid the difficult but .challenging 
task of developing a viable theory of instruction. There obviously is a place for 
the learner^ judgments in making instructional decisions: for example, suciv 
judgments play an important role in several parts of our BIP course. However, 
using, the learner\s judgment as one of several items of information in making 
inslniclional decisions is different from proposing that the learner should have 
complete control. Results presented in this chapter and tlu)se cited in Beard, 
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Lort )iu Searle, and Atkinson (1^)73) indicatL' tluU the leurner is not a particu- 
larly effective decision maker in guidinj; the learning process. 

[{Isewhere 1 have defined the criteria that must be satisiied before an optimal 
instructional procedure can be derived using formal methods (Atkinson, 1972ah 
Roughly stated, they require that the following elements of an histructional 
situation be clearly specified: 

- I, The set of admissible instructional actions. . 

2. The instructional objectives. 

3. A measurement scale that permits costs to be assigned to each of the 
instructional actions and payoffs to the achievement of instructional objec- 
tives. " 

4. A model of the learning process. 

If those four elements can be given a precise interpretation, then it is usually 
possible derive an optimal-instructional policy. The solution for an optimal 
policy is not guaranteed, but in recent years powerful tools have been developed 
for discovering optimal, or near optimal, procedures if they exist. I will not 
discuss these four elements here except to note that the. first three can usually be 
specified with a fair degree of consensus. Issues of short-term versus long-term 
assessments of costs and payoffs raise important questions regarding educational 
policy, but at least for the types of instructional situations examined here 
reasonable specifications can be offered for the first three elements. However, 
the fourth element the specification of a model of the learning process- 
represents a major obstacle. Our theoretical understanding^ of learning is so 
limited that only in very special cases can a model be specified in enough detail 
'to enaMe the derivation of optimal procedures. Until we have a much deeper 
understanding of the learning process, the identification of truly effective 
strategies will not be possible. However, an all-inclusive tlw )ry of learning is not 
a prerequisite for the development of optimal procedures. What is needed is a 
model "that captures the essential features of that part of the learning process 
being tapped by a given instructional task, twen modeKs tliat have boQU rejected 
on the* basis of laborator>' investigationi; may be useful in deriving instructional 
strategies. Several of the learning models considered in this chapter have proven 
unsatisfactory when tested in the laboratory and evaluated u,sing standard 
goodness-of-fit criteria: ncvertlieless, the optimal ,strategies they generate are 
often quite effec:tive. My own preference is to formutate as complete a learning 
model as intuition and data will permit and then use that model 'to investigate 
optimal procedures. When possible the>learning model should be represented in 
tlie form of mathematical equations, but otherwise as a set of statements in a 
coniputer-sirnulation program. The niain point is thatuthe development of a 
theory of instruction cannot progress if one holds the'view that iuomprehensive 
theory of learning is a prerequisite. Rather, advances in learning theory will 
affect, the development of a theory of instruction, and conversely the develop- 
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ment of a theory of mstructioii will ijiniience the direction%)f research on 
learning. . * 



ACKNOWLEDGMENTS 

'Hiis research was supported by the Omce of Naval Research^ Contract No. N()00I4-67-A- 
0012-0054. by National Science loundation Grant KC-43997, and by (ka' t MH-24747 
from the National Institute of Mental Health. 



ERIC . , 



5 

Methods and Models 

for Task Analysis 

in Instructional Design 

Lee W. Gregg 

Carnegie-Mellon University 



A theory of inslructiori must be based on the objectives of the learner and the/ 
institutionalized goals of the instructional system. A theory /f instruction must 
also rest upon an adequate formulation of the psychological capacity of the 
learner. Instructional goals prescribe the domain of task^to be undertaken by 
the learner; the psychological capacities of the learner set limits, on the sjze, 
. complexity of the subtasks and the rate of introducing them into the domain. 

Each of the first four chapters presents a framework for analyzing tasks from 
various .psychological perspectives. Carroll contrasts strict behaviorism with a 
^currently nonexistent cognitive theory of learning. Calfee takes a statistical view. 
Resnick ecleetically draws from Gagrie's hierarchies, Gestalt Psychology, Thorn- 
' dike, and Piaget to formulate a rational information processing scheme. Atkin- 
son's approach uses optimization proce^dures to guide instructional design. 

In general, instructional design attempts to organize subtask sequences, 
provide opportunities for learning, and devise ways of evaluating the extent to 
which the learner acquires proficiency. Notice that these general activities are 
neutral with respect to methods of analysis and models of the learner. Thus, 
teachers have been searching continually for hew ways to break up tasks into 
teachable units. The key concepts for many instructors are differentiation, 
followed by integration. If Carroll is right in his assessment of the role behavioral 
sciences play in education, behavioral objectives will be ignored and soon 
forgotten. They will become just one more fad" thrust on the field. Behavioral^ 
objectives may give way to cognitive objectives as defined by Greeno in Chapter ^ 
7. If Carroll is ri^^t, the naive theories of learning on which many an artful / 
teacher predicates lesson plans will be explained by cognitive theory, but not 
necessarilyextendedby.it. 
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. CarrolL of course, is right- at least in part. Cognitive theories and iiirornuUion 
processing models will supplant some of the currently fashionable iiolions- thdy 
have already dt)ne so. Furthermore, there is evidence from the set of current 
chapters of a cumulative body of knowledge dealing with important issues of 
task analysis and. instruction that a lasting contribution will result. 

What are tlie steps in a task analysis? First, we set out to identify component 
skills such that mastery of the individual skill components a.ssurcs partial success 
on the task. We assume that the hierarchy of skills exists and that components 
are independent. Calfee attacks the issue of independence directly. To the extent 
tiiat subprocesses like decoding and comprehension can be treated indepen- 
dently, the analysis of components will be successful. One direction that re- 
searcji must take is the identification of the conditions under which tasks^may 
conform to a simple additive hierarchical decomposition. Next in the sequence 
of analysis, we introduce compo^ients one at a time. As Rcsnick points out-in 
Chapter 3 these components must be teachable. The usual next step in the task 
analysis requires that we start where the learner is and build on what he already 
knows and can do. Here tl.^ '*ssues revolve around the diagnostic tests for 
determining the initial state of the learner, and the development of instructional 
materials that exercise the component. InstructitJiial materials, the teaching 
routines that Re.snick refers to, must provide a basis for integrating the new 
learning with the old. But the third stage of task analysis attempts to integrate 
the newly acquired skills into a meaningful whole. Of special concern are the real 
time constraints. Very often, subtasks that appear to be well learned fall apart 
when combined in new ways. Think of the feeling of helplessness when you last 
tailed to recall the name of a close friend in performing introductions around a 
griiup. Paced recall is not .a cognitive task that wc are asked to perform 
frequently. • 

Arc there cognili^ve theories of learning that can be applied to the job c)ftask 
analysis? Cnrrolfs- revievv (jf naive, behav'oristic. and cognitive theories of lan- 
guage barning suggests that a cognitive learning theoryjjow exists. Unfortu- 
nately, recent- vvork on semantic inemory (Norman, Rufn.elhart, el uL, J975;. 
Qumian, ]%7, ]%8: .Schank. 1^)72), has been primarily concerned witli deter' 
mnung the structure of memory represcntatitins. Research on the processes of 
understanding (Hayes & Simoiu 1974 and this.volume: Winograd, 1972) assume 
that a knowledge base is already learned and available. Of course. Greeno has 
asserted lhal learning theory and comprehension theory defined in information 
processing terms are the same tiling (Greeiu), 1974). My own work on sequeniial 
pattern learning (Gregg. 1967), verbahjearn.ing (Gregg & Simon. 1967), and serial 
learniifg (Gregg, 1972: McLean & (;rbgg. 1967) leads me to argue that they are 
not, the same. One difference is in the development .of intermediate structures in 
working memory that Greeno has previou.sly described. However." it seems 
appropriate to stress the similarities between learning and the processes of 
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understanding. Both 'depend on attention to determine the final outcomes. Both 
require contiguity of the elements to be: associated. The study of comprehension 
and learning is the study of cognitive organizations. 

Although there is no explicit and general cognitive theory of learning, there 
have been isolated examples pointing potential future directions. The Elemen- 
tary Perceiver and Memorize r, EPAM,^was the first modern theory of semantic 
memory and showed the main outlines of associative. memory structures. Atkin- 
son and Shiffrin's (1968) model for running paired associates learning accen- 
tuated the importance of control processes in learning and memory. Just as the 
role of semantic memory emphasizes structural aspects of representations of 
knowledge, short-term^ memory studies emphasize the dynamic operation of 
control processes in specific tasks. Learning and comprehension, therefore, are 
similar precisely because they come about from the operation of the^ human 
information processing system. His processing limitations determine the rate of 
acquisition of new information and its availability for use in problem solving. 



INDEPENDENCE OF COGNITIVE SKILLS 

Are the processes that the human information processing system uses detectable 
from an analysis of overt behavior in instructional task environments? This is the 
issue that Calfce examines'in Chapter 2. 

The method that Calfee proposes is dimed at finding out whether or not 
processes are independent. Finding they are not is not very informative. Since 
the method does "^oi generate process descriptions, only tests the effects of 
them, one must create variables to test the hypothesis that a'process whose 
operation may or may not be correctly reflected by the measure, exists. There 
are two stages at either of which an error can occur. Each stage provides an 
, opportunity for error. One can incorrectly .assume that a process exists that 
.transfc)rms a data structure in a certain way. But one can also incorrectly assess 
the effects of the hypothesized process by failing to define a relevant dependen^t 
variable. , 

Most of the theorizing must go on in advance of and independently of the 
testing operations suggested by Calfee. Modern inference procedures make it 
possible to carry out much more powerful analyses of system interactions. 

Even though the model of reading proposed by Calfee appears to be correct, 
the processes must not remain independent for long. The still higher order 
cognitive processes in speed reading and comprehension cannot depend on 
simple additive components because selective, intentional use of strategies im- 
plies the constructive use of components. 

We must distinguish between pedagogically useful packets of information and 
the information processing mechanisms that may or may not view the materials 
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to be learned in the same way that the instructor views them. Are the human 
mechanisms really independent? Tlie answer is contingent on the extent to 
which we can show sequential order in Ihe processing of the information. 



INTERACTIONS OF SEQUENTIAL PROCESSES 

In any information processing system, there will be a lack of statistical indepen- 
dence among the subprocesses if the output of one processes provides inputs to a 
later process in the sequence. Since we believe that m.ost cognitive task involving 
attention are serial, there are few tasks for which a strict independence of the 
processes is likely. The question is not whether they are independent for they 
arc almost certainly not. The crucial question is, "How are they organized?'' 
How do we study interacting processes? What forms of organization exist? 

One of our most popular notions of task orgaaization is the tree structure. The 
implication is. that higher-level elements g'-ow out of well formed lower-level 
elements. Subtasks are subsumed as components of and precursors to other 
tasks. But most accounts of learning and analyses of errors during learning 
suggest that the prior elements are not stable>and must change. Even when the 
learner brings well developed skills to the task, there arc confusing periods 
during which the prior elements are being modified. The notion that prior 
behavi* . are incorporated into higher organizations whole cloth is probably 
wrong. ' ' ■ 

^ Two aspects of the learning process suggest why. First, more complex behav- 
iors usually involve the intergration of serial patterns. Hence, the merging of 
behavior sequences tends to slur one pattern into another. New patterns result. 
The distinction between components is changed; and new boundaries are d/awri. 
Second, when more complex behavior patterns are learned, the simpler prior 

' • patterns are. changed in that the' evoking stimuli are different. An example of 
■ these kinds of modifications will be seen later. 

As Resni^ck warns, there can be a great deal of difference between competency 
in early stages of learning and in later stages. One reason, I belipve, is that the 
^ component skills +issume new forms when they merge in higher-order patterns. 
The organiza"tion of more complex skills, whether mental or motoY, is analogous 
to a compiled computer subroutine. Once assimilat'ed into the repertoir^ there is 
no need to test each separate instructional during execution. Thus, mental skills 
take on the properties of automatic motor performance. For example, inpjaying 
the piano, practicing left and right hand separately emphasizes sight reading 
skills, builds habits that are not relevant for the coordinated combination of 
both parts. When playing- the two parts, the places where one must merely check 
the score can be quite different from those of single-handed and single-minded 
practice. ^ 
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In summary, we suppose that location of the tests may change, the size of the 
perceptual or conceptual unit may vary, and that cues for initiating or sustaining 
the behavior, may be different at different stages of practice. 

INDlVIDUALlZATfON AND TASK ANALYSIS 

Atkinson's approach stresses the idea that the learner nlust be able to follow 
flexible'pathways througli a subject domaine. Optimization of CAI learning'tasks 
is based on a curriculum composed of -a network of related tasks and a loose 
collection of associated skills. In Atkinson's view, subtasks and'skills need not be 
related in a rigidly hierarchical fashion. This in not to say that the instructional- 
materials for CAI are not carefully thought through. Rather, the point is that 
individual learners can achieve higher performance levels in a variety of ways.' 
For the specific areas of application, there is a '"careful analysis and precise 
specification of the .skills inherent in the subject matter.'' Thus, for Atkinson the 
subject matter defines the structure of tasks; the learner acquires skills that are 
inherent, i.e., determined by the task denmuds. 

Optimization is based on an empirical procedure to assess transfer of training. 
Thus, it is possible for a student to shift from one strand to another based on 
performance within the first strand. Control of the process is guided by a model 
of learning that provides a complete response histojy which then in turn feeds a 
Markov model. The optimization procedures are based on empirical results of 
transfer and acquisuion using simple models of the performance during learning. 
Trial by trial selection of items and exercises procedes from a determination of 
each student's ability and each item's difficulty. At the most global level, 
optimization is over the allocation of student time to each strand. 

In these procedures, Atkinson has captured the crucial questions of instruc- 
tional design that each teacher asks: 

1 . What items and. exercises should I give? 

2. How should the student's time be distributed over the different classes of 
work? 

3. How should the resources available for instruction be iillocated among the^ 
students? 

Atkinson shows how far one can go toward answering tliese questions with 
relatively simple models of performance during learning. His experiments on the 
optimum sequencing of vocabulary items indicates the kind of gains one can 
expect froni the systematic selection and presentation of items for study. 
Improvement of the order' of 50 . and 100% are, indeed, impressive results. 
Atkinson points out that 'comprehensive theories of learning are not necessary to 
produce important differences in rate and"degree of learning. 
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1 view Chapter 4 by Atkinsim as a landmark Wn CAl applications. In it we see 
three important demonstrations the state of the art in appropriate applica- 
tions of computer based instruction. First, the Basic Instructional Program (BIP) 
represents an appropriate use of the computer as a problem solving tool. The 
learner masters a programming language under the direction of the system which 
assesses his or her level of problem-solving skill and tutorially guides the learner 
thnmgh increasing levels of skilled performance. It has been several years since I 
leveled the criticism that most CAl work did not use" computers in ways for 
which they were intended (Gregg, 1970). Clearly that comment caliaot be 
applied to Atkinson's work. The second part of Atkinsoii'^s c'iapter describes bis 
analysis of the reading task audit's acquisition. Here a sophisticated analysis of 
the .skilKs required in reading is presented and a scries of exercises within each 
strand defined. Although on a trial by trial basis, the model that determines the 
setiuence of learner experience is a powerful application of decision theoretic 
ideas to transfer from strand to strand in a complex structure based on task 
analy.sis. In that earlier criticism, I said that it seemed waste-to use computers 
as glorilled memory drums. Atkinson's program for the instruction in initial 
reading bears no resemblance to .so stupid a machine. Perhaps the only legitimate 
oriticism that remains is that certain complex cognitive tasks that require under- 
standing will require complex cognitive analyses. In the chapters that follow, 
models of semantic memory, sentence comprehension, and understanding writ- 
ten problem instructions point the way for these new developments, 

SUBJECT STRATEGIES AND TASK ANALYSIS 

o 

Resnick\s review of concepts underlying the analysis of instructable components 
poses several challenges. The issue is how to combine components logically to 
produce the desired behavior of presumably higher complexity. Instructional 
design rests on the premise that a sequence t)f component tasks can be identified 
and then mastered in some order to produce behavior. Tlie jnfegration can have 
logicakamplications. The* ideas of Osherjion (1974) on logical grouping capture 
the hierarchical nature of performance combinatorics, but not the order infor- 
mation that 1 have stressed so heavily in this discussion. 

The reason I believe serial order is so important is evident when we consider 
that a subject strategy consists of a sequence of cognitive acts involving shifts in 
attention and transformations o'f objects, Thus, in any prctblem-solving task or 
learning situation, a complete description of the psychological problem space- 
must inchide the representation of the,specific objects and the set of operators' 
to be applied. In a later chapter, Simon and Hayes discuss problem isomorphs 
where superficially distinct problems map onto the same problem space. Hence^ 
differences in problem-solving performance can be attributad to a failure to find 
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an efficient represtntation for the task. But here I am talking about performing 
an identical task where only the instructions to the learner vary. 

In a recent, unpublished* experiment by Gerritsen, Gregg, and Simon, the 
subjects were instructed in three strategies. All other conditions of the experi- 
ment were the same. The strate gies, however? caused the subjects to attend to 
different aspects of the ^problem as it was being solved. Both the stimulus 
information and the transformation rules were different for each strategy. 

The experimental task was similar to Restle's (1970) serial pattern' learning 
task. The problchi was displayed before the subject consisting of a digit from 
one to six and a series of ^3, 4,' or 5 letters which stood for the symbolic 
Operators: T >was transpose, add one; M was mirror, obtain the sevens compli- 
ment; and R was repeat. The subjects responded by pressing buttons labeled 
with the values one to sLx on a panel in fron^ of them. ' 

The three stiategies were called the Doubling, Recompute, and Pushdown 
Metliqds. Bach specified a different information processing sequence and each 
resulted in quite different response measures and error patterns. In fact, perfor- 
mance an the task varied by a factor of 3 to 1, from 2244 msec per response for 
the Recompute Method to 721 msec per response for the Doubling Metliod. 
Such robust effects from instructions^alone argile that any attempt to identify- 
ing- skill componeats must be certain of their implementijition in terms other 
than task variables. 



'conclusions - 



The moral of this research story is simply that subject strategies are crucial to an 
understanding of . cognitive performance. One way of viewing the entire problem 
of instructional task analysis is to say that the goal is to specify a complete set of 
subject strategies sufficient to the task, to map feasible strategies onto the 
current information processing skills of the learner, and finally to develop 
instructional methods and materials such that the learner acquires those strate- 
gies that have the greatest educational value. 

Resnick, in Chapter 3, showed that children will invent strategies and these 
may be more efficient than those derivqd by curriculum designers. Chapter 7 by 
Greeno will show that we can teach better or worse strategies. The challenge for 
instructional. design is clear. 
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My purpose in this chapter is to discuss five general points presented in chapters 
of Carroll, Atkinson, CaH'ee, and Resnick that underlie the discussion or develop- 
ment of a theory t)f instruction. 

First, 1 want to indicate my t)pinit)n as io the current status of the enterprise. I 
believe that a theory of instruction is a legitimate scientific goal and that such a 
theory has as examplars some impressive local successes (e.g., Atkinson*s work). 
However, it is easy to overestimate its current status. As it now stands, the 
theory of instruction is very primitive and not at all at a stage requiring complex 
: mathematical descriptions for its expression. Considerations of the nature of 
^performance, the nature of knowledge, the nature of the communicable and 
instructable, and the nature of experience -some of which have been raised by 
Carroll and Resnick as well as by others (cf. Olson & Bruner, 1974)-are 
conceptual issues that must be faced in the attempt to construct such a theory. 

At the more specific level of optimal design, that is, research directed to the 
production of an explicit instructional program designed to achieve a particular 
educational goal, the achievements to date are more irflpressive. Programs de- 
. sigiied'to achieve a particular goal, such as those described by Atkinson, Resnick, 
and Calfee (Chapters 4, 3, and 2, respectively, of this volume), and others sjich 
as Sesame Street (Palmer, 1975) can be described quite precisely and achieve 
their goals quite successfully. ^ 

But what is the relation between specific instructional^ programs, the problem 
of design, and a general theory of instruction? AtT<inson raised tliis point in 
regard to the *'depth*' of the theory based on the set of pa'ran^oters found to be 
relevant to the optimization of a particular instructional program. The 'theory* 
is, as I understood him, primarily an equation optimizing the particular set of 
parameters for that set of tasks. The problem is that that equation would not be 
generaliitable to a new, quite different set of tasks. How then do we get to a 
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general theory of instruction tl^U would apply to tlie vast array of things that 
are taught to all sorts of learners by a vast array 'of meatis? It. is about this 
general theory of iniitruction that we know so little. 

Stated in another way, the relation between particular procedures and general 
theory maybe conceived in terms of the relation between cira;!^/? and theor}\ In 
the analysis of instruction are we concerned primarily either with the problem of 
desigamg effective Instructional systems (cf. Richards, 1968, 1974) or with the 
construction of a theory that would make explicit the nature and consequences of 
the experiences managed by formal institutions such as schools. And it is difficult 
to serve these two gcnils at the same time. 

Second, I want to consider what a ^Vognitive" instructional theory would look 
like. If we simply adopi "behavioral objectives'' or if instructional theory is 
concerned^. only with optimization, cognitive theories are, to say the least, as 
luxury. What could a cognitive theory add? As Carroll pointed out, cognition 
means knowledge. A cognitive theory would be concerned with the nature of 
human knowledge, how it is represented and how it is acquired. But in instruc- 
tion, we are not concerned with all knowledge but rather with that knowledge 
which is ot such social value that the society creates an institution to guarantee 
tliat it is transmitted to every child growing up in that society. Wliat is that 
knowledge and what are the means at our disposal for conveying it? 

Carroll argued that a theory of instruction that takes seriously the nature and 
acquisition of knowledge would make Instuction more effective. Calfee and 
Resnick by their research programs show that they agree.: And they may be 
right. But in being right they would be indistinguishable from any behaviorist or 
social engineer. Again, then, what could cognitive psychology add? 

Cognitive psychology could be concerned, not with prediction and control and 
optmii/ation, but rather with '^understanding.'' Objective knowledge, borrowing 
from Popper (1972), is a record of the culture's solutions of important 
problems. As ,such, knowledge complements the adaptive resources given to us 
through the genes and those iicquired through our own personal experiences. 
This knowledge is coded in terms of the .symbc)l systems of the culture, 
particularly natural language;. Such knowledge is shared and therefore social in 
nature. In content and in structure and in social significance this knowledge is 
distinctive from that acquired via direct practical activity; presumably the 
processes involved in [he extraction of such knowledge are distinctive and^the 
consequences ol' the acquisition of this knowledge are unique. A theory of 
instruction, therefore, is needed for more than simply improving the power of 
our procedures: it is needed to help make explicit just what it is we are doing to 
children and adults in the process of sociali/.ing them. Then we will be in a 
position to decide which of these effects are worthwhile as well as which means 
are effective. 

To summarize this point: instructional theory should be concerned not only 
with optimization, cinitrol, or the achievement of behavioral objectives but also. 
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aij^d more basically, with making explicit the nature and 'the consequences of the 
transmission of socially useful knowledge. Once these processes are explicit they 
are subject to rational consideration, as Popper (1972) has argued. So we require 
a theory of instruction that would cast into theoretical terms what is already 
going on in the schools, and elsewhere, in the name of instruction and what is 
being ahered with the introduction of new types of programs whether they be 
activity programs, or CAI, or whatever. 

Third, I would like to consider instruction as the communication of explicit, 
formalizable routines. This point is related to Resnick's interesting suggestion 
that good instruction may trade off communicability with formal adequacy. 1 
recently published an article titled "What is worth knowing and what can be 
taught? (Olson, 1973)" in which I argued that much of the knowledge most 
worth having- making discoveries, speaking convincingly, writing effectively, and 
various .social and ethical skills-cannot be taught explicitly because the algo- 
rithm underlying them (if indeed there are such algorithms) are not known. 
Many that are known are too complex to communicate easily (consider, for 
example the passive transformation in English). Yet, in another sense, these 
important skills may be 'taught' by providing demonstrations and by providing 
sessions for repeated practice accompanied by appropriate feedback. 

To summarize this point, some knowledge is formalizable-an algorithm for 
adding, for example, and can be taught explicitly. But other, more complex 
skills, including many socially valued skills, cannot be taught explicitly and they 
may have to be 'taught' through demonstrations or modeling and/or tlirough 
making allowances for learning through trial and error or ^muddling. And a 
theory of instruction is going to have to specify the nature and the role and the 
consequences of modeling and muddling as well as the more explicit intervention 
which, for the sake of alliteration, we may call meddling. 

H;)urth, consider the relation between knowledge and likill or knowledge and 
performance. Carroll raised this issue in regard to the ' linguist's distinction 
between competence and performance. Cognitive psychology contrasts with 
behaviorist theory in assuming that knowledge can be wrested from the purpose 
for which it was acquired and the cpntext in which it was acquired and cast into 
more general symbolic form, thus rendering that knowledge applicable to a 
much wider range of problems. 

Schools clearly got carried away with the assumption that the acquisition of 
theoretical knowledge, what Ryle (1949) called propositional knowledge, was the 
sine qua non of education, perhaps giving some legitimacy to student's current 
protest against the value ofbeingstuffed with ^'irrelevant" knowledge. 

This issue hangs critically upon an understanding of how knowledge relates to 
performance. F-rlere's book The Pedagogy of the Oppressed (1972) makes the 
case that the only liberating knowledge is knowledge acquired by praxis -SiCiion 
coupled with reflection. Perhaps useful knowledge must be acquired in the 
context of action. Minimally, a cognitive theory of instruction must indicate 
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how knowledge is related to performance both in its acquisition and its subse- 
quent use. 

Fifth and finally, I want to argue in a prelinnnar>' way that the means of 
instruction are not simply instrumerfralities in instruction. This point is based on 
the concept of the bias of communication (McLuhan, I964;hinis, 1951). The 
way, the means by which one is taught, biases what is learned in a way that has 
largely escaped detection. I have recently argued, fOlson, 1974) following the 
leads of Havelock (1974), Goody and Watt (1968), Bruner, (1966) and others, 
that the particular reliance in our culture on the use of language out of the 
context of practical action has put a distinctive mark on both our cultural 
patterns and our cognitive processes. Specifically, the use of written prose as a 
means of instruction recruits and develops a set of mental competencies t^iat are 
gener^il to a wide range of intelligent performances. To illustrate, the fact that 
we learn Chemistry from textbooks which utilize the peculiar language of explicit 
written prose results not only in some'knowledge of chemistry but also of literary 
skills of a high level. These skllls^-the ability to see the logical implications 
of written statements, and more importantly, the ability to formulate general 
statements from which true inferences can be drawn are mental skills of great 
importance and generality. But because they are a specialized set of skills, they are 
appropriate only for some kinds of tasks: im\ they may lead us to undervalue other, 
equally important but different skills such as those involved in the arts or, for that 
matter, those involvt?d in common-sense judgments. Instructional theory will have 
toaccount for the nature of means before it can be regarded as agcneral theory. 

It is this somewhat vague, general, and preliminary level of conceptual analysis 
that, I believe, will yield now understanding of the nature of instruction. 
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Part II 



PROCESS AND STRUCTURE 

IN LEARNING 



As the anatomist, with his 'microscopical- 
study of the stomach, may finally suggest 
the ways for cooking more digestible food, 
so the experimental psychologist will com- 
bine and connect tlie detailed results' more 
and more, till he is able to transform his 
knowledge into practical educational sug- 
gestions. . . . Single disconnected details are 
of no value for such a practical^ transforma- 
tion; and even after all is done, this more 
highly developed^ knowledge will be but a 
more refined understanding of qualitative 
relations-never the quantitative measure- 
ment which so many teachers now hopefully 
expect'[Munsterberg, 1898] . 




Cognitive Objectives 
of Instruction: Theory of 
Knowledge for Solving Problems 
and Answering Questions 

■ James G. Greeno 
The University of Michigan 

A great deal of progress has been made in recent yeiirs toward the understanding 
of many cognitive processes. Psychological theories that have been developed 
and tested deal with perceptlon/memory, thinking, and language processing at a 
level of detail and specificity that is an order of magnitude beyond the theoreti- 
cal concepts available only a few years ago. 

My purpose in this chapter is to show how some of this body of theory can be 
used in the formulation of instructional objectives. The motivation for this is 
quite simple. The goal of instruction is that students should acquire knowledge 
and skills of various kinds. A rich set of concepts has been developed in scientific 
psychology that can be applied to analyze the structure of knowledge and 
cognitive skills. Thus, it should be possible using those concepts to carry out 
analyses of the knowledge and skill that are desired as outcomes of instruction. 
It may be expected that the explicit statement of instructional objectives based 
on psychological theory should have beneficial effects both in design of instruc- 
tion and assessment of student achievtjment. The reason is simple: we can 
generally do a better job of accomplishing something and determining how well 
we have accomplished it when we have a better understanding of what it is we 
are trying to accomplish. 

The view 1 am taking hiis much in common with the opinions of many., 
educational psychologists (such as Anderson & Faust, 1973) who recommend 
that instructional goals be formulated as behavioral objectives. In the view taken 
here, development of iiistructional objectives begins with consideration of the 
kinds of tests used to assess whether students have, acquired the knowledge 
intended as the outcome of learning. But rather than just specifying the behav- 
iors needed to succeed on such tests, cognitive objectives are developed by 
analyzing -the psychological processes and structures that are sufficient to 
produce the needed behaviors. 
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There is an important psychological assumption implicit in the position taken 
here. I am assuming that the goals of instruction, including aspects of conceptual 
understanding, can be inferred from the tasks that students are expected to 
perform during instruction and, following instruction, on tests. If this is ac- 
cepted, then it follows that a theory specifying cognitive structures and pro- 
cesses sufficient to perform those tasks is a candidate hypothesis about what tlie 
instruction is trying to produvx>. Of course, any candidate that, is proposed can 
and should be questioned regarding issues of substance. T am confident that the 
specific features of the objectives I will present here can be improved, althougli I 
have fried to incorporate reasonable psychological assumptions into these illus- 
trative cases. However, the general kind of description offered here should be 
taken as a completely serious proposal about what the goals of instruction are 
like. It may be that^when we see what kinds of cognitive structures are needed to 
.perform criterion tasks, we will conclude that something important is missing; 
hut if that is the case, it also will be important to identify a more adequate set of 
criterion tasks in order to ensure that instruction is promoting the structures we 
think are important. 

I have chosen t^rec substantive, domains in which to develop illustrative 
cognitive objectives t)f instruction. The first is elementary material in fcurth- 
grade fractions: the second is introductory material in high-school geometry . and 
the third is some material from introductory college psychology dealing with 
auditory psychophysics. None of these is developed to anything near a complete 
and detailed set of objectives; however, I hope that I have developed a suffi- 
ciently specific example in each case to make the enterprise credible. One reason 
for choosing these three examples is that they represent instruction' carried out 
at widely different age levels. 1 believe that our current stock of concepts and 
techniques in cognitive psychology is adequate to the task of analyzing instruc- 
tional objectives from ' elementary school through college, and my choice of 
examples is meant to back up that belief. 

A related point about the choice of examples is that they illustrate some 
important broad relationships between knowledge that is imparted to students 
of different ages. The knowledge needed to do computations with fractions 
seems to involve a simple kind of algorithmic skill tjiat can be ^expressed easily 
with fiow charts. Suppes and Morningstar (1972) developed similar models for 
analysis of addition, subtraction, and multiplication; Suppes (1969) has called 
these automaton models. Tasks used for instruction in high-school geometry 
require a more complicated set of procedures and knowledge structures. Knowl- 
edge that is required for geometry can be -represented as a production system, 
including mechanisms that are found in current theories of problem solving (e.g., 
NewelJ & Simon, 1972J for setting goals and searching in a problem space. The 
probien>solving system uses numerous procedures of the kind taught to eiemen-. 
'tary-school students, so knowledge of the first kind is embedded in the more 
complex structures required for the more mature learning. 
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The instructional objectives for college psychology seem to require still an- 
other, lev^l of cimiplexity. Understanding auditory psychophysics requires ac- 
quisition of a complex network of concepts of the kind we are familiar with in 
theories of semantic memory (Anderson & Bower, 1973; Kintsch, 1974; Nor- 
man, Rumelhart, &. Group, l975;''Quillian, 1968) and performance on many 
^^CTiterioiT tasks (such as essay examinations) requires a procedure for generating 
paragraphs in answer to complex questions. We are just now beginning to 
explore fhe kinds of cognitive capabilities needed to produce structured verbal 
output at the level of paragraphs (e.g., Abelson, 1 973; Crothers, 1972; Fredetik- 
scn, 1972; Rumelluirt, 1975). The mechanisms of generating explanations 
apparently share significant features with mechanisms of generating solutions for 
problems, but there are also significant differences, due at least in part to the 
more open-ended quality of the task. 

EXAMPLE 1: FRACTIONS* 

Much of the work on fractions required of students involves carrying out 
calculations such as finding equivalent fractions, adding and subtracting frac- 
tional numbers, and finding common denominators. Ability to carry out those 
calculations is a minimal objective of instruction, and it can be represented in a 
psychological theory as a fiow chart showing the component processes of the 
procedure. In general, the procedure is not unique -there are more ways than 
one to calculate the correct answer. Alternative procedures can be represented in 
different models, or incorporated in a single nondeterministic model that allows 
different branches to be taken. . • ■ 

Procedural 'Representation of a Concept 

Figure i shows a procedure for adding two fractions. The upper part of the 
diagram shows a procedure for finding fractions with a common denominator 
. that are equivalent to the numbers given in the problem. The lower part sketches 
the operi-tjon of checking the answer and reducing if necessary . 

If the procedure shown in Fig. 1 is accepted as a psychological mode! of adding 
fractions, then it is a candidate for an instructional objective in the elementary 
mathematics curriculum. The concept of adding fractions is a procedure, and a 
goal of instruction is to have students acquire that procedure as part of their 
cogkiitive equipment. The idea of representing a concept as a cognitive procedure 

M have been privileged to participate in a number of . discussions of children's learning of 
fractions with my colleague Joseph Payne and his students: Many of the opinions and 
judgments that I have about fractions have been developed in tliose discussions, although 
Payne and his group surely should not be held responsible for faults in my understanding. 



131 



126 JAMES G.GREENO 
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fraction: 




c 




d * b 





find equivalent 
fraction: 

a a' 

b ' d 




find least 

comrnon 
mul tiple 
of (b,d) 
> m 



find equivalent 
fraction: 



find equivalent 
fraction: 



FIG. 1 Procedure for addition of fractions. 

is famiiiar in recent theoretical work. Examples include HuntV(1962) analysis 
of categorical concepts as procedures for classifyir)g stimuli, and Winograd^s 
(1972) theory of language understanding, where concepts are procedures for 
identifying objects and answering questions about their locations. 

Cognitive Representations of Quantity 

Procedures like Fig. 1 can compute answers, but they lack conceptual under- 
standing of a kind that many educators would w^in: students to acquire. Texts 
such as the one by Payne, May, Beatty, Wells, Spooner, and Dominy (1972) 
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include numerous exercises like the one shown in Fig. 2, for which the student is 

to fill in the blanks of" out of pieces are shaded/' Otlierexercises present 

sets of discrete objects, such as a .row of circles, some of which are colored 
differently from the others, with a question " - out of circles 
are red." The intent is for students to begin by seeing fractional quantities*^., 
represented pictorially, as parts of regions or as subsets. 

An important issue in the theory of mental computation is thg way in which 
quantitative information is represerited. A procedure like Fig/ 1 is neutral with 
regard to the representation of^quantity — that is, quantities could be repre- 
sented in a variety of ways and the procedure could.be designed to wbrk..on any 
of them. I suggest that the instructional objective reflected in exercises like Fig. 
1 can be represented in a theory about the ways in which fractional quantities 
are represented. ' 

I will distinguish here among three representations of quantity; there probably 
arc more, but these' seem to be the main possibilities, involved in elementary 
instruction. The first representation is just an ordered alphabet of numerals/ 
Students 'can count, and the list produced by . counting provides a precedence 
relation on the numbers. Basic operations of addition, subtraction, multiplica- 
tion, and division may also be stored as relations on numbers— for example, "five 
times three equals 15,'* may be in cognitive structure as a sequence of verbal 
associations. 

A second representation involves actual or imagined quantity, the number of 
items in' a set. A system could be designed with a counting mechanism for 
.assigning a nuniber to any s6t, but with operations of addition, multiplication, 
and so on carried out on sets rather than directly on numbers. For example, to . 
find 5X3, imagine a set of five objects, tfien imagine three of those sets, and 
count the total number of objects in the three sets. 

A third representation uses geometric forms, and quantity is represented as the 
spatial extent of a form. Addition and subtraction can be represented as moving 
to. the right er left on a "number line. To iliiultiply 5X3, imagine a rectangle 
divided vertically into five sectio^is, where the measure of each section is taken 
to be one. Then the rectangle is made three times as large-imagine two more 
rectangles just below the first one with the three rectangles concatenated, 
forming a single large rectangle. The total measure of the large rectangle is 15,' as 




FIG. 2 Diagram representing a fraction spatially. 
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could ^be confirmed by counting al] the sections of si^e equal to the original 
sections. 

It would not be realistic to suppose that arithmetic operations are generally, 
carried out by anyone as operations on sets or regions. No one multiplies 9X7 
by-imagining nine objects, each reproduced seVen times, and counting the total; 
we remember that 9 X 7 is 63, However, teachers. and writers of texts apparently 
feel that it is useful to introduce procedures for mani»?ulating quantity as 
operations on spatial representations or on representations of sets. If Piaget 
(1965) is correct, addition and multiplication of numbers depend on the same 
basic cognitive operations as additive and multiplicative combinations of sets 
(and, we niiglit suppose, regions-though that may involve some additional 
sophistication about space and geometry; see Piaget, Inhelder, & Szeminska, 
I960). With or without Piaget's theory, it is reasonable to assume that students' 
acquisition of basic arithmetiq.^concepts i$ aided by connecting those concepts 
with operations on sets and spatial quantity, siiice they have "observed many of 
'those changes in their experience. ^ \ 

• When fractions are introduced, they can be related either to diagrams i^howing 
geometric shapes divided Into pieces, or to diagrams showing sets of objects of 
different kinds. Fractions can also be defined for the students as a combination 
of operations including a multiplication and* a division (Dienes, 1967b), although 
this would generally be done Ln connection with diagrams involving sets or 
-regions. 1 will not try to present a fulj analysis^^ere ofVill the relative advantages 
of va.^rious ways of presenting fractions. My goal will be to show that the 
cogiiltWe representation of quantity can play an iiT\portant role in procedural 
representations of mathematical concepts. I believe that the formulation oP-^ 
psychological theories involving different representations giyes some new clarity 
tc\ the issues involved in choosing a way to present mathematical concepts, and I 
will illustrate this with some discussion of the issue regarding fractions. Howpver, 
this discussion should be seen as an illustration of a way in which cognitive 
objectives can te used discussion of alternative instructional methods, rather 
than firm nidvocacy of a particular method. 

Alternative Obfectives with Differing Representations ; 

The plan of the rest- of this section is as follovys: 1 will present three models that 
find eciuivalont fractions when the^.denoniinator of the fraction to b^ computed 
is a factor or a multiple of the fraction given. One of the models incorporates a 
process of ^generating a unit region and operates on that region by forming 
sffhregions either by subdividing or collecting pieces of .the region. A second 
model uses a process of gencratijig set.s, forming subsets by partitioning the set 
and generating members. Tlie third model is a simple algorithm for computing 
equivalent fractions using operations of multiplication and division defined on 
numbers. Tlie -reason for developing these models is to show how theoretical' 
analysis of a task can provide specific, psychological characterizations of alterna- 
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partition the c 
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output 
exit 



FIG. 3 Procedure Un finding equivalent tractions, u-.ing spatial representation of fractional 
quantity. 



tive instructional goals. 1 will also give some tentative discussion regarding 
implications of the different models for acquiring other concepts related to 
equivalent fractions. 

A model that uses spatial processing oF a region is shown in Fig. 3, and Fig. 4 
shows traces of the program as it solves two problems. This model and the ones 
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6. • X = 6 ^ 6. X = 2 

7. output: ^ ^ • ■ 7. output: | 

FIG. 4 Traces of the procedure for equivalent fnictions using spatial representation. 

that follow assume that the.problem has been formulated so'that one denomina- 
tor is a multiple of the other, and the answer is an integer. If these conditions are 
not satisfied, these processes return failure. The representation of fractions in 
Figs. 3 and 4 is like the one shown in Fig. 2, and a reasonable'curriculum would 
Use introductory exercises like Fig. 2 as preparation for learning the st ucture^^of 
Fig. 3. 

Figure 5 shows a model of finding equivalent fractions using a process that 
includes a mechanism for generating sets, members of sets, and subsets. A trace 
of the progran^'s solution of two problems is shown in Fig. 6. 

A third model of finding equivalent fractions is given in Fig. 7. This represents 
a simple algorithm for finding the correct answer, without the involvement of 
any imagery or diagrams; 
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FIG. 5 Protvtnirc Un tuuling equivalent tractions, using set-theoretic representation of 
fractional quantity. 
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4. 



5. 
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6. 




7. 



output: 



3. 



7. 



output: 



FIG- 6 I ..;os or the procedure for equivalent fractions using set-tlieoretic; representation. 

It should be noted that some features of processing assumed in these models 
are based on my intuition rather than on any data that I am aware of. For 
example, the first step in the problem 6/15 = X/5 in Fig. 5 when it nQted that 
c<hh to imagine (or draw) a set having c subsets as elements. In effect, I have 
assumed that a subject generates abstract place-holders that will become sets 
when elements arc generated. There are alternative models that are also plausi- 
ble. For example, one iniglit assume that initially i\ set witli h elements is 
generated; then tliey are grouped into subsets having M = 'b/c elements in each 
subset; then the elements in a of tlie subsets are marked; and finally is found 
by counting the marked elements. As far as I know, the choice I have made in 
showing Fig. 5 rather than the model sketched above is an arbitrary one. 
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Twi) comments should be made about these arbitrary features of processing 
that are hicorporated in theories presented here. First, in many cases experi- 
mental tests of the models could be deveh)ped to distinguish between ahernative 
models, if it were considered important to distinguish between them empirically. 
Second, it may not be critical to distinguish between models differing in 
processing details if the details lack important implications for quality of student 
perforn ance in instructional situations, or the ability of students to progress to 
further stages of knowledge and understanding, JThe variations that 1 have 
thouglit of within the three classes of models th;it I have presented seem 
relatively unimportant to me as regards instructional implications. 

However, I think the differences aniong the three models diagrammed in Figs, 
3, 5, and 7 probably are significant in connection with students' ability to use 
concepts of fractional quantity in later learning and in situations that arise in 
experience. It is a reasonable hypothesis that procedures like those of Figs, 3 and 
5 arc important In applying fractions in situations that arise. in experience. The 
argument is as folh)ws: in situations involving continuous quantity (such as 
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fractions of cups of substances used in ciM)king) and in situations involving sets 
of discrete units (such as fractions of individuals in a group who favor a certain 
action) there is quantitative infcnmation. It is likely that a person will have a 
^ cogriitive representation of this infonnatimi in the form of a spatial representa- 
tion of contnuious quantities, or a set-theoretic representatit)n of discrete units,^ 
Hien procedures that can use those representations directly arc more likely to be 
applied. than procedures that rccjuirc translation from tht)se representations to 
numerical rcpresentatitins, such^'as Fig. 7 wt)uld. 

Tlie other consideration invt)lves acquisition of further structures involving, 
fractional quantities. There are reasons io expect that the spatial representation 
involved in Fig. ,V may provide a better basis tor understanding addition and 
subtraction of fractions than the operatit)ns on sets involved in Fig. 5. Note that 
if Fitz. 3, the two ei|uivalent fractions (such as f and 7is) are represented in 
the spatial domain a.s equal quantities. In the set-theoretic representation a 
change in the denominator invtilves a change in the number t)f elements in the 
set: this means that the relatitinship that is preserved between equivalent frac- 
tions does not correspond to an invariant quantity. 

Now consider adding two fractions such as f +4-. It clearly is ptissible to do 
that in either representation, but it seems mtire natural in the spatial representa- 
tion whore changes to conumni tientiminators do not ret|Uire changing the spatial 
.size of the unit, in the set-theoretic representation, fractions with different 
denominators have different numbers of elements in the'total sets for example, 
< involves a set with five members, while ^lis invtilves a set with 15 members. 
Thus, it might be expected that when students have learned to think about 
fractimuil cjuantities as parts of regions, they might nuire easily learn addition 
and subtraction of fractions than if they learned tti think of fractional quantities 
as subsets. This expectation has some support in a study by Coburn (1973), who 
compared two instructional sequences for intrtiducing fractions. In one condi- 
tion, fractions were introduced 'vvath diagrams of regions, with a fractional 
(juantity corrcspmiding lo the part of the whole region shaded or marked in 
some way. The other condition involved presenting iVactjons as ratios, primarily 
of numbers of obiects in different sets (such as the ratio of squares to circles, 
where there miglit he five squares and eight circles). Both sequences included a 
unit on addition -.nd subtraction of fractions, althougli the ratiti group required 
some instruction on part-whole relations prior to learning about. adding and 
subtracting fractions. The two grtnips did equally well in addition and subtrac- 
tion of fractions with equal denominators and on other general problems 
involving tractions. However, in uddititni and subtraction of fractions having 
unei|ual ileiiormnalors, there was a substantial advantage tavoring the group 

* IlitHo is eviJciue ilux persons roprcsoru fiuaii riLirivo iiifortnatioii in spatial Images, even 
wht^n t\w inf«»nna{!nn' is pn^scnted verhails; stv' DoSoU). Kondon, and Handel. 1965; 
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receiving the introductory material based on regions rather than ratios of the 
numbers of members in sets. ^ 

The hypotheses developed here about alternative representations and addition 
or subtraction of fractions also seem to favor the spatial model regarding transfer 
to other topics, such as decimals. Representation of fractions as subsets implies 
that equivalent fractions are equivalent relations between quantities that are not 
equivalent, and when applications involve equivalent quantities there may be a 
conceptual difficulty produced by the set-theOretic fepresentation. On the other 
hand, numerous concepts and applications involving fractions apparently call for 
understanding of the kind of invariant relation involved in the set-theoretic 
representation. This seems to be the case for multiplication and division of 
fractions, and for many .applications involving percentages (cf. Begle, 1967). 

It seems surely to be the case that the desired outcome of instruction included 
both the models shown as Figs. 3 and 5, and the model of Fig. 7 as well, since 
that provides for efficient computation. There are important psychological and 
pedagogical questions regarding relations among different representations of 
quantity. I will not try to develop an analysis of those relationships here. It 
would have to be largely speculative at this stage of our knowledge, but 
considerable attention is being given in current research to problems that should 
provide; substantial clarification of this issue. 

Conclusion 

The examples worked out here for fractions have the feature of all t'ask analyses 
in showing ir\ some detail what it is that students must do in order to perform 
successfully on exercises and tests. The knowledge needed corresponds to 
procedures for carrying out computations, and at least in the present treatment, 
concepts such as addition of fractions and equivalent fractions are a form of 
procedural knowledge. The procedures can be defiried on different representa- 
tions of fractional quantity, and alternative models of the concept of equivalent 
fractions were presented, based on representations involving spatial extent, 
numbers of elements in sets, and simple numerical representation. Implications 
of the differences among the models were suggested. 



As students progress in mathematics training they are expected to carry out 
tasks that are more complex and require greater skill in solving problems. Plane 

^1 am grateful for the assistance of John Greeno and Katie Greeno who provided 
thiriking-aloud protocols of their solutions of problems in geometry. We worked through the 
section of parallel lines in a text by Clarke (1971), intended for preparation of students for 
the British ordinary -level examinations. 



EXAMPLE 2: -EUCLIDEAN GEOMETRY^ 
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FIG. 8 Diagram for ii problem in angles and parallel lines. 

'geometry, tauglit iri' the ninth or tenth grade, requires sophistication in problem- 
solving procedures that is qualitatively difft/ent frtim that represented in the 
instructional gi)al>s Wn fractions. 

The majt)r new requirements involve mechanisms for creating goals as part of 
ijie prc'jcess t)f solving problems. In most exercises in elementary arithmetic, 
some numbers are presented and a prticedure is specified-for example, "Add j+ 
J." In many exercises given in higli school geometry, a situation is presented and 
a goal is specified, and the student is required to sup^ply a set of procedures for* 
achieving the goaj. In order to understand what students must know in order to 
succeed on problems tif this kind, we need to use concepts taken from the 
theory , of problem solving, where goal-directed search mechanisms have been 
analyzed (Newell & Simtm, 1972). 

Consider the diagram shown in Fig. 8; the question is, ''Given that P- 30°, 
find Q.^' This kind of problem is given is a.geumetry course when students have- 
studies parallel lines with transversals, and before they have the theorem that 
opposite angles in a parallelogram are equal. Stilution requires relating angle Q to 
•some other angle in a diagram which in turn in related angle P, or finding 
some longer chain of angles related tt) each tither. A solution found by one 
subject uses the angles marked in Fig. 9, Angle A and angle P are congruent, 
because they are corresponding angles, so .4 = 30°.^ Angles A and B are congruent 
for the same reason, so B = 30"". Angles B and Q are supplementary because 
together they form a straight angle; thus, angle Q is shown U) have measure Q = 
180" -30'' = 150^ 



Knowle?dcje for Solving Problems • 

f will now present hypothe.ses about the knowledge students need .to solve 
^ problems in geometry of angles and parallel lines. There are three main compo- 
. nents of the theory. First, there is a representation of students' ability to 



ERIC 



142 



y. COGNITIVE OBJECTIVES 137 




FIG. 9 Additional angles used in solving the problem (Fig. 8) and diagram showing 
relations lictwcon .ingles and quantities used in the solution. 

recognize relations between angles based on their locations relative to each other 
and to parallel lines. A second component represents students' knowledge of 
propositions such as, ''corresponding angles are congruent." The third compo- 
nent is a mechanism that sets goals and selects components of the knowledge 
structure that iire needed in solving specific problems. 

Recognition of relations. To solve a problem of the kind shown in Fig. 8, one 
requirement is dial students learn to identify relevant relations between pairs of 
angles. A standard exercise involves presentation of a diagram like Fig. 10, with 
instriiclions to ''Find four pairs of corresponding angles, eight pairs of alternate 
angles, and four pairs of verticle angles/' The performance required of students 
is that they be able to identify certain patterns of relational properties. The 
relevant psychological theory is the theory of pattern recognition. 

In current theorie^^if pattern recognition if is assumed that recognition 
consists of identifying a learned pattern of features (Feigenbaum, 1Q63; Hunt, 
1962; Selfridge, 1959). The knowledge required to recognize patterns is a 
network of feature detectprs, linked together in an appropriate way. Figure 11 
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FIG. 10 Diagram tor identification of angles having various relations. 



Start: identify x, y, 
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shows part of a network for identifying relations between' angles. The relations 
shown are alternate angles, interior angles (on the same side of the transversal), 
and corresponding angles. These are relations between angles with different 
vertices, having two sides that are parallel. The notation used refers to sides of 
angle .v as .s'v and Z^, and the vertex of angle x as r^, and ^iimilarly for angle;'. 
Note that at.. the top of the diagram there is a test to determine whether th^ 
angles being tested have a single vertex. A positive outcome here would send the 
system off to components not shown here, where vertical angles and adjacent 
complementary or supplementary angles would be identified. 

The system shown in Fig. 1 1 has the form of im EPAM net (Feigenbaum, 
1963). To illustrate the recognition system, follow the tests that would occur for 
a pair of corresponding angles, such as D and // in Fig. 10. First, the angles have 
different vertices! Thev do have a pair'of sides that are parallel, so parf^^^^ ) is 
positive. The-i remaining sides are not 'a single segment, so ident(r^, ty) is 
negative. However, the side of angle // is a straight-line extension of the side of 
angle /J), so.extd(r^., .fv) positive. The angles are both above their respective 
parallel sides, so ,samc{v. v: a\ / Sy) is positive, and both arc on the left side of 
the transver,sal. so same [.v, Cv)ncat(/v. )1 positive. The system thus arrives 
at corr(.x\ ,r) and exits with success. 

In FPAM, feature tests are carried out serially, in a fixed order. 1 will present 
some considerations shortly that question this aspect of the model, and I do not. 
consider that a critical feature of the theory. The important psychological idea is 
that a system for recognizing patterns is a network of feature tests, and students 
must acquire such a network as part of their knowledge of geometry. ^ 

Network of propositions. Students also learn numerous propositions involv- 
ing relations among angles. For exanaple, "corresponding angles are congruent,'' 
and ^^idjacent angles that form a straight angle are supplementary." A set of 
propositions in memory is commonly represented as a network in which nodes 
represent concepts and links represent relations among the concepts (Anderson 
& Bower, U)73: Kintsch. U)74; Norman ctaL, Severnl propositions from 

geometry are shown in Fig.-12.- 

First, consider connections in the network where nodes are linked by dashed 
lines. An example is (VERT .V Y) (CONG X F), vertical angles are congruent. 
Sometimes there are three properties involved, as where (RT X) and (RT Y) and 
(CON(; A' )') are all joined; the proposition , is that if and }' are both right 
angles, then and y''are congruent. 

The dashed arrows in Fig. 12 correspond to inferences that can be rn^de or 
conclusions that can be taken. For example, the student can conclude that X 
and Y are c<mgruent if it is known that X and Y are vertical angles. The 
propositions shown in Fig. 12 thus correspond to productions in the sense of 
Newell and Simon (1972), for each proposition has a condition and an action 
component. The condition is given at the tail (or tails) of an arrow, and the 
action is given at the head. 
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FIG. 12 Network i,r pmposilions eorfcspondint; to productions used in soivins problems' 
about angles ;ind par^illel lines. 

The representation in Fig. 12 simplifies the situation in an important way The 
nodes there represent states of affairs that correspond to propositions. It is 
useful m considering problem solving to unpack those propositions and represent 
them as rehuional structures. This is done in Fig. 13. There, dashed lines still 
represent mferences that can be made, but they are inferences that derive a 
proposition from other propositions. Each proposition consists of one Or more 
elements (frequently angles) and a property or a relation involvingahe ele- 
ments). Figure 13 also represents several propositions about the measures of 
angles. For example, in upper right corner there is the proposition, if A' and Y 
are cumplei:ientary angles, then the measure of X plus the measure of Fis 90°. 
In the upper left corner are represented some complicated but important 
propositions^ about the measures of concatenated angles; for example, if angles 

^' ^ ^ concatenated to form angle X, then tlie measure of A"is equal 

to the sum of the measures of /I, /?,... , and A'. Note that there is no specific 
notation to distinguish between the angle X and the measure of angle X When 
an element goes through an arithmetic relation (= +, or -) it is understood that 
the element is the measure of an angle. 

Now return to Fig. 9, and consider the network that represents the relations 
among angles in the diagram used in obtaining the solution. Initially the 
intormation is given that P = 30", ahd the problem is to find the measure -of Q. 
The solution is obtained as follows: First, angle A is noticed, and since A and P 
are corresponding angles, the measure 30° is assigned to A. Next, angle B is 
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noticed, and since A and 5 are corresponding angles, the measure 30*^ is assigned 
to angle B. Finally, since B and Q form a straight angle, the measure of Q is 180° 
- 30° ~ 150°. Note that each of tliese inferences is represented in the diagram by 
a -dashed line. The solution "bf the problem is shown as a connected relational^, 
network that satisfies the requirement of connecting Q with a quantity-that is, 
assigning a measure to Q. Each step in solving the problem corresponds to a 
proposjtion found in the network of propositions showfi in Fig. 13.. 

'Problem-solving procedures. Knowledge structures like those represented in 
Fig. 11 and. Fig. 13 are necessary for a student to solve geometry, bujt they are 
not sufficient. An additional requirement is a system for interpreting a problem, 
setting goals, and selecting productions from tKe knowledge base for use in 
generating the relations needed for solution of the problem. The ideas to be 
presented here are an attempt to use intuitions about problem solving that have 
been recognized for many^years, especially by Duncker (1945), Selz (1913), and 
Wertheimer (1959). Wlien a problem is understood, the person perceives certain 
structural relations among components of the problem. However, the structural 
pattern is not complete, and tliat is why there is a problem. Thus, problem 
solving can be seen as a process of modifying a structure in order to complete a 
pattern. Recent contributions to the theory of problem solving have developed 
formal representations of goal-directed pattern matching (Hewitt, 1969; Win o- 




FIG. 13 Network of productions showing propositions as links between relations in com- 
ponent propositions. 
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grml, 1972) and search for operators or productions that acliicve progress toward- 
sohition of a problem (Ernst & Newell, 1969; Newell, 1972b; Newell & Sunon, 
1972). 

Problems in the geometry of parallel lines and angles can be solved by a system 
that can satisfy goals consisting of patterns that may be matched in the problem -, 
situation. The system keeps a list of angles whose measures are known, and a list 
of relations between pairs of -angjes that have been found during the process of 
problem solving. The system knows about quantitative relations such as (CONG 
' X y"), .V and }' are congruent, and (SUPP X 7), X and Y are supplementary. If 
alst) knows about geometric relations such as (CORR X Y) and (VERT X Y), 
which it can evaluate using feature test.s such as those in Fig. 11, and it knows 
which quantitative relation can be" inferred from each geometric relation, as 
''showri in Fig. 12. 

A probjem is presented in the form of a diagram, a. goal, iind some given 
jrifornuttion. The ^ystem a.ssimilates the given information and sets the goal as 
presented. V^)X the problem shown in Fig. 8, the structures are 

(MEAS/\^0) (GOAL*(MEASC^?NUM)) 

(My notatiiin here is a mixture t)f NewelTs (1972b) notation for a production 
^system {)riented toward problem solving, and the simplified PLANNER , syntax 
used by Winograd ( 1 973). Tlie asterisk marks the current goal of the system;'and 
IS replaced hv if the goal is set aside temporarily while another goal is 
attempted. A pattern such as (MEAS Q ?NUM) specifics a property or relation 
first, then the objects that have the property or relation. A question mark 
indicates a gap in the pattern, and the goal is to find some object that satisfies 
the gap. For example, ?NUM indicates that the gap is to be filled by a number.) 

The system works by evaluating its current goal. There are several kinds of 
goal, each corresponding to a procedure. The procedure succeeds if certain 
specified conditions nre found in the daia structures containing list of known 
measures and, relations on angles. If a gtuil succeeds, the system carries out an 
action culled ASSKiN which adds an appropriate entry to the data structure and 
ileletes the accomplished goal from the goal s.tru'cture. If the goal fails, a new goal 
is created and the old goal is saved. The system tries to accomplish specific goals 
first, then retreats to weaker goals that can produce results of possible use to tlie 
stronger goals that have failed earlier. 
As an example, when (GOAL * {Ml^AS O ?NUM)) i.s evaluated, -each anglq 
^ with known measure is examined to see whether it is part t)f a structure in which 
a quantitative relation links the known angle with iingle Q. The procedure used is 
a variant of the-MATCIi process used in HAM (Anderson & Bower, 1973). If 
such a structure were h)und. the procedure would return a structure of the form 
(QR Q NUM) Where QR is the quantitative relation found (CONG, TOMP, 
SUPP, or CIR), and NUM is the numerical value of the known angle found in. the 
structure. If the goal succeeded, the system would carry out the action ASSIGN- 
MhA.S, creating a data structure in which Q would be assigned a measure equal 
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to NUM if the relation found were CONG, dr 90 - NU^ if QR were COMP, or 
180 ~ NUM if QR were S6PP, or 360 - NUM if QR were CIR. In solving the 
problem of Fig. 8, the goal of assigning measure fails initially, so the; system 
takes the action (SETGOAL (?QREL Q ?ANGM). 
Now the goal structure is the following list: 

((GOAL * (?QREL Q ?ANGM)XGOAi: % (MEAS Q ?NUM))) 

Again, the system examines the angles with known measure, hoping to create a 
structure in which a quantitative reladon links angle Q witli a known angle. This 
goal s::cceeds if there is a data structure in which Q \l linked to a known angle 
through one of the geometric relations fCORR, VERT, ST, ... ) from which a 
quantitative relation can be inferred. Again, no such relation is found, so the 
system tries to create one, setting up • ' 

(GOAL*(?RELQ?ANGM)). . 

This goal examines the angles with known measure, testing the features of each 
one. in relation to Q using the recognition network shown in Fig. 11. This fails, 
since P, the only known angle, has no side that is either identical to a side o|f Q 
or a straight-line extension of a side of ' 

The system hasj failed in all its attempts to directly link Q with an angle that 
has known measure. It then retreats to the' following goal: 

(GOAL * ((MEAS ? ANG ?NUM)(NEARER 0 ? ANG 7ANGM))). 

This goal tries to assign measures to. some angle that can be found in the dia- 
gram that is nearer angle Q than some angle whose measure is already known. The 
property NEARER is defined on a path consisting of transversals between 
parallel lines. The procedure takes P (still the only known angle) and works 
through its list of geo.me trie relations until it finds one tliat it can pair with P 
and match the features of the pait" with the pattern needed to identify the 
relation. In the diagram of Fig. 8, all the geometric relations can be found for 
angles paired with P: presumably the one that is found is the one at the top of 
the system's list of relations. (Note that trying to find an angle fitting a specific 
relation involves activating a terminal node in the recognition network and 
testing the pattern of features connected to that node, rather than working 
/down the network from the top. The process is again analogous to. the MATCH 
process in HAM (Anderson & Bower, 1973). in this case the probe received by 
MATCH is the angle Pimd a terminal node that names a relation.) 

The goal finds angle A and identifies the relation (CORR P ^), then returns 
the structure (CONCJ A 30). This leads to assigning measure 30 to angle yl in the 
list of known angles. Now the system returns to its previous goal (?REL Q 
7ANGM). With a new known angle is the list, a geometric relation with t3 might 
be found, but it is not. (Note that all the features of corresponding angles are 
present except the last one requiring that the angles.be on the same side of the 
transversal.) This causes the system to recreate the goal ((MEAS ?ANG ?Nl 
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MXNEARER Q ?ANG ?ANGM)), which succeeds through finding (CORR/l B) 
and returns (CONG B 30); then the system assigns measure ^30 to angle B. 

Now the system r(>turns to its goal (?REL 0 ?ANGM) again, and this time it. 
finds a -knovvn angle related to Q: the goal now returns (ST O B) and this 
structure is entered in the list of known relations. Now the preceding goal 
{?QREL ?ANGM) is reactivated and it succeeds, returning (SUPP Q B). 
Finally, the system returns to the initial goal (MEAS Q ?NUM) and this- 
succeeds; the last act is to assign measure ! 50 to angle Q. > 

The preceding illustrates. the process of problem solving. 1 will now present a 
brief description of the general features ofithe problem-solving system. At the 
highest level, the procedure is a production system that takes a goal as a 
condition, and evaluates t,he goal as an action. Then the outcome of evaluating 
the goal becomes part K the condition, imd an action of creating a data 
structure is carried out if tjhe goal succeeded; otherwise, a new goal is created. At . 
this .level, the. model represents general skills involved in problem solving, 
including such strategies as trying to find a direct link between da.a and 
unknowns, and then if that fails working on something more complicated. 

The procedures for evaluating goals incorporate knowledge about t^ie rela- 
tional properties a/id propositions involved in the task domain. Each evaluation 
procedure looks at data structures that represent relations among components of 
the problem, and determines whether other needed relations can be inferred. 
This amounts to a production system functioning .at the level of specific 
inferences made during the process of solving a problem. As an example, the 
proicess of evaluating the goal (7QREL X ANGM) and \,the procedure 
(ASSIGNQREL) is equivalent to the follo^ving set of productions: 

(GOAL*(?QREL|.V?ANGiM)) and (GOAL%(MEAS r?NUM)) and 
(KY X Y) ^(COMPX Y) 

(STX Y) -^fsupp Jir yo. 
* (CIRCLE .\'r) ->tCiR;irr) 

'(VERT.Y Y) ^<CONGX Y) 

{VORKX Y) >(CON(i,V Y) 

(ALT A' )') >(CONG J n 

(INTSAM.VK) -(SUPPA'n. * , 

That is, when the goal structure is as shown in the .first line, and the data 
structure contains the element on the left of one of the other lines, then the 
element on the riglu of that. line can be created. 

Pattern Rpcoqnition and Constructions 

In many geometry problems, the material presented does not periiiit a solutfon; 
the problem solver must supply additional lines. An example of such problems 
is in Fig. 14, given that AB is parallel to CD, find an equJition competing A", K, 
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A B- 



FIG. 14 Dia^jram tor a problem 
requiring a construction. 



C D 

and One solution is obtained by constructing a parallel to'AB througli the 
vertex of creating angles and y.-Then (ALT -V ) .Y = y'l and (ALT 
ZVa) >/ Vi, giving y, + >'2 = A' + Z, and then (CONCAT(ri Y2)Y)-^Y^ 

The interesting psychological question is how the problem solver thinks of 
making the construction. One-way for this to happen would be to arrive at tjie 
goal of finding a relation between and Y, test the features of some relation, 
and find a partial match. In fact, one subject solving this problem said, "If there 
were a parallel line here, then X and Y would be equal." 

In order to solve problems requiring constructions, the problem-solving system 
should be able to detect partial patterns, and should have productions for 
completing patterns by adding new points and lines in the problem. Recognition 
of the need for a construction is similar to the understanding of a problem-it 
involves matching components in the problem with a stored problem and finding 
a gap (ir a partial mismatch. The idea sketched here of constructions related to 
subgoals and pattern recognition is quite similar to Celemter's (1963) treatment 
of the problem, where constructions are developed when subgoals have failed, 
and a frequent cause of failure has been the absence of a feature that can be put 
into the problem with an available construction theorem. The present discussion 
has considered only the process of recognizing that a construction would be 
useful: actunl mechanisms for making ccuistructions have been described by 
Scandura, Durnin, and Wulieck ( 1974). 

Meaninqful Solution Structuros 

Oestalt psychologists such as Duncker (1945) and Wertheimer (1959) empha- 
sized the desirability of teaching students meaningful solutions of problems, 
'rather than rote, mechanical forms of solution. The concept of meaningfulness 
in problem, solving has generally depended on the intuitions of authors and. 
readers. Perhaps sorne progress can be made toward pinning the concept down 
by examining the relational networks that represent alternative solutions to 
problems. " ^ 
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FIG. 15 Diaj»ram for the pro- 
blem of vertical angles. 



I Will discuss one,of the problems that Wertheimer (1959) considered, the 
problem of vertical angles. I will present analyses of two solutions that Wer- 
theimer presented to illustrate his distinction between meaningful and rote 
soluti>)ns. These solutions will be compared, and two distinguishable criteria of 
meaningfulness will be suggested. 

iMgure 15 gives notation for the problem of vertical angles. Given that and 
^1) are straight lines that intersect at 0, prove that X and Y are congruent. 

A typical statement of tlie proof goes as follows: 

1, X + LAOC^ 180'\ since they form a straiglit angle. 

2, K-HZ^OC= 180'', for the same reason as (1). 

3, J + M0r=Y+/^10C,sincethey bothequall80^ 

3. X= r, since Z>10C can be subtracted from both sides of (3). 

A graph Showing the relations in (his proof is shown in Fig. 16. 

Wertheir^er criticized tliis proof as being rote and mechanical. His evidence 
that students fail to grasp important relations included the observation that 
when asked to recall the prqof, students often write X + MOC = 180°, 7 + 
IB^D = and then become puzzled. 

An alternative proof that seems t6 Ht Wertheimer's criterion of meaningfulness 
coyld be stated as follows: 

\. LAOB and l/)OCare congruent, since they are both straight angles. 
2. X andA/l DC form LDidC by concatenation. 




FIG. 16 Diagram of a solution 
of the problem of vertical angles 
primarily using algebraic relations. 
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3, Y and LAOC form UiOB by a)ricatenation. 

4, X and Y are congruent, because they form congruent angles wlien they are 
concatenated with the same third angle. 

A diagram showing this proof is shown in iMg, 17. 

There are two apparent differences between Fig. 16 and Fug, 17. First, Fig. 17 
is slightly simpler than Fig. 16, Second, Fig, 17 uses only geometric relations and 
properties, while most of the relatit)ns in Fig, 16 are algebraic. It seems 
reasonable to .suppose that both of these properties relate to meaningfulness of a 
solution. 

One sense of the concept of meaningfulness involves coherent structure. We 
would say that a student has better understanding if all components of a 
problem are linked closely with many t)ther components, rather tfian each 
element being connected with only one or two other components. In general, 
closer linking will corre.spond to simpler structure. In Fig. 17, the congruence of 
X and Y is derived in one step from the congruence of LDOC and LAOB, 
combined with the concatenations involving Z and ywithZ^OC In Fig, 16, the 
route to j!f = ^' is sliglUly more circuittuis, involving equality of two quantities 
because they both equal 1K0'\ and an algebraic operation on the expressions X + 
L40Cand K + ZylOC. 

It should be noted that the simplicity of a certain kind of solution is well 
defined only with respect to a fixed set of productions. A simpler structure than 
Fig. 16 would apply to a subject who had a production 

(,V + .4-A0 and (Y-^A^M)^ {X = Y). 

It seems to agree with intuition that a student ^ith a richer set of complex 
productions would have a better understariding of problems than a student who 
had to work out many sequences of small steps. On the other hand, this shows 
that the question of meaningfulness canntit be decided on grounds of simplicity 
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ill favor of one kind of solutu)ii rather than am)thor» since either can probably 
have a complex or a simple versioru depending on the complexity of a person's 
knowleilgc. 

The second leature distinguishing F-igs. 16 and 17 is the extent to which tiiey 
use geometric relations, rather than algebraic operations. I think that this may 
have been what Wertheimef had in iiiirul in referring to understanding structural 
relations in this problem, rather than applying an algorithm in a way that oTten 
might seem arbitrary in the sense of lacking motivation in the domain of the 
problem. 

The distinction can be made ri^^orous if we define two problem spaces, one 
having productions that we call geonintric, the other having productions that we 
cair algebraic. A problem in gconi^l'ry can be solved entirely in the problem, 
space of geometry, if an appropriate set of productions exists there and they are * 
found ami applieil. Alternatively, there may be a mapping of some geometric 
propcrlies and ri^lations into the domain of algebra. These could be translations 
of properties, or they could involve productions that take geometric properties 
as conditions and create algebraic objects as actions. \Vlien objects are created 
that can satisfy the conditions of algebraic productions, then problem solving 
can go on in the problem space of algebra. After an appropriate set of produc- 
tions has been applied, a translation back to geometric objects can be carried 
out, if it is needed. (Strictly speaking, the solution in Fig. 16 is-incompiete. A 
final step using the pri)position, "4f two angles haVe equal measure, they are 
congruent,'' would finisli the job.) 

The distinction between solving a problem in its own problem space and 
translating into- another for' purposes of computation probably is subject to 
considerable bkirring, especially if we ccmsider the result of experience in 
applying productions from one domain to solve problems in another. Jt seems 
likely that any pair of productions of the form A B, B C. if used often 
enough, would soon lead to the existence* of a production A C. By a similar 
process of fusion, it seems likely that a student who has applied algebraic 
operations many limes to geometric cfjiantities (spatial representations of angles, 
areas, and so on) would probably have what amounted to a set of productions 
fi^r. manipulating geometric quantities, without explicit trjinslation into algebraic 
operations. Clearly, the question of meaningfulness of a problem solution is 
relative to the sf?ecific set of productions that a problem solver has%available, 
whether we consider meaningfulness as solving iti the problem domain or as 
producing as a solution a well-integrated relational structure. 

I have some anecdotal evidence that achievement of the apparently more 
meaningful solution in fact depends im the student's having a general production 
for manipulating quantities of the form ^ 

(rONCAT(/1 ^).V) and fCONCAT (/I O D ' 

and (CONG .\r >') - (CONG i5 0. * . 
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One* subject with whom I have worked on tliis problem did not know how to 
prove that vertical angles are congruent when we began. I gave the steps of a' 
proof stating the two sums that equal 180°, making a single equation, and 
obtaining the equality by subtracting the same quantity from both sides of the 
equation. About two weeks later, I asked the subject whether she remembered 
the proof; she did not. Ther) I gave some different examples involving concatena- 
tion of quantities. One example involved weighing suitcases by holding them and 
standing on a scale. If two suitcases produce the same weight when they are. 
combined with a person, the suitcases must be of equal weight. The other 
example involved distances from city to cit^ given on a map. |f the distance 
from Liverpool to London via Birmingham equals the distance from Birmingham 
to Dover via London, then the distance from Liverpool to Birmingiiani must 
equal the distance from London to Dover. With these items of background, the 
subject generated the proof of equal vertical angles. Then she solved Wer- 
theimer's transfer problem where tlie angles shown are overlapping right angles, 
and she remembered the proof about vertical angles on two later occasions-one 
two days later and the other seven months later. 

This anecdote does not provide sufficient evidence for any definite conclusions 
about exact structural relations in the problem of vertical angles. It does 
illustrate a use of the theoretical analysis in identifying the cognitive component 
needed to solve special problems. In this case, if my analysis is correct, the 
needed component is a production dealing with combinations of quantity in a 
general way, rather than with specific geometric concepts. 

Conclusion 

Geometry represents at least two levels of knowledge that are more complex 
than are involved in the simple kinds of computation involved In elementary, 
fractions. The recognition network needed to identify relations between angles 
involves a concept in the form of a procedure for processing stimulus features. 
That seems no more compW than the procedures for findir|^ equivalent frac- 
tions and other similar operations in elementary arithmetic. However, the 
inferences needed to solve problems require a network of p'ropositional knowl- 
edge corresponding to productions that take properties and relations as condi- 
tions and generate new relations as actions. And the system requires general 
knowledge of relations between goals, to select propositions in a way that will 
lead to solutions'to problems that are presented. 

The general analysis of problem solving as recognition of {Partial patterns 
provides a framework for analyzing the process of recognizing the need for a 
construction in a geometric problem. The 'framework also provides a way of 
comparing solurions of problems that partially clarifies the troublesome concept 
of meaningfulness in problem solving. 
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EXAMPLE 3: AUDITORY PSYCHOPHYSICS 

The tasks to be a)nsiclerod in this tliird section require yet another increase in 
the complexity of performance by a student. Nearly all problems given in liigh 
school mathematics are vvoii-defined problems in die sense that they present a 
specific goal and a specific ^iet of premises or data' to work from. In many 
situations students are asked to produce paragraphs or brief essays as answers to 
questions. \V\n\e many questions require only simple retrieval of factual informa- 
tion from memory, others present ill-defined problems (Reitman, 1965) in 
which the student nmst generate more than a path of operations leading to a 
goah 

The material that I will etmsider in this last section is part of the content of 
introductory college psychology, and the selection of content for this discussion 
is taken from the introductory text by Lindsay and Norman (1972). I do not 
intend to suggest that the kinds tif complex semantic processing that I will 
discuss hero are ccuifined to ct)llege-age adults. The processes are required 
whenever a person generates cornplex substantive material, as in the telling of 
stories, and much of that is done by quite young children. Certainly, complex 
([uestion answering is expected of students in junior high school and high school 
ui many of their courses. 

• ti , ' 

Semantic Networks 

A structure of concepts and relatitins can be represented conveniently as a 
network, and a majority of invostigattirs iise such . a representation to chiirac- 
terize the knowledge required f(^r answering questions (see especially Anderson 
& Bower, 1^73: Kintsch, 1974; Norman et al.. 1975). The notation that I will 
use here is similar to that of N<Jrman et al. (1975), which also is included in 
Lindsay and Norman's (1972) text and is used ui Norman's chapter in this 
volume. I have, however, reversed the roles tvf elements and relations, partjy to 
he corisistoirt with my earlier discussion and partly because some of the discus- 
sion of this material is helped by having attention foeusscd on relations rather 
than on concepts as the main components of the structure. 

The ccmtent of psychophysncs includes concepts from physics, biology, and 
psychology. Mo ^ of the infc^rnation given by Lindsay and Norman about the 
physics of sound is shown in Mg. 18, Most of the relations shown such as ISA, 
HAS, and CAl^SL have been used.. frequently in many discussions t)f semantic 
memory. ISA denotes category membership. HAS denotes a relation of property 
attribution, which takes several forms not distinguished here such as having parts 
(components of a cornplex wave) and having units (such as Hertz for frequency). 

The representaticm of F'ig. 18 is, of course, higl ly schematic. A complete 
description would include many distinctions not made in the diagrmn, and 
would require elucidation of several components. In general, the concepts and 
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relations correspond to schemata that can be unpacked if necessary either by a 
theorist tor more detailed annlysis or (in a different sense) by the subject wHen 
necessary in considering specific aspects of a topic or question. An example is ' 
the concept of a function, which is a general schema involving a relation of 
correspondence between members of two or more sets. Thus the node 
LATliS and the presence of twc) variables whose values are connected by the 
function are expected as parts of the schema indicated here by the single term 
*Munction." This kind of conceptual embedding is discussed in more detail by 
Norman, (Jentner. and Stevens in Chapter 9 of this volume. 

The dashed lines and diagrams in F^g. 18 involve concepts whose understand- 
ing apparently ihcludes production of a diagram or image. The hypothesis 
involved here is similar to that used in the section on fractions, where I 




cortex 



FIG. 19 Notwork ot prupt»sitions tor anatt)niy ot Iiciriiiii. 
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presented tlie idea that. some processing can be mediated by use of a representa- 
tion of quantity either in spatial or set-theoretic terms. The use of genetative 
processes involving images , l^r question answering has been noted before, 
notably by Jorgenson and Kintsch (1973) and by Norman (1973). Norman's 
discussion is especially pertinent. His example involved generating a floor plan, 
and subjects used rules based on general propertied of ropms and buildings, even 
when this led to mistakes in the specific task they were engaged in. 

Just as many of the nodes in Fig. 18 represent aoncepts that are not spelled 
oat in detail, the diagrams presented there only sketch the representation\that 
we would hope students acquire regarding sound Waves. The procedure for 
generating the image of a sine wave should be con\iected to the concepts of 
frequency and amplitude in ways that I have not woi-ked out in detail, and the 
properties of the various diagrams involving concepts of vibrations, a pressure 
wave, and a sinusoidal function all should be related to\each other in definite 
ways not specified, he/re. Analysis pf these cognitive stiuiciures would be a task 
well within the technical capabilities available at present]^ although some new 
understanding would probably be achieved by developing Retailed models here, 
as with other domains. \ \ 

Figure 19 shows a semantic network containing the main cipncepts of anatomy 
connected with hearing. Tliis figure seems entirely strai^t forward; however, 
■note that HAS has yet another meaning here (the cochle^ is characterized by 
some of its properties, and by some of its parts), and the relation CONNECT TO 
refers to rather 'different kinds of anatomical relations (the way in which the 
malleus is connected to the incus'is qxiite different from the \way hair cells are 
connected to neuro^ns). , 

Figure 20 shows network of concepts that refer to events th^t occur when a 
sound wave produces a neural reaction in the brain. The descriptions of proper- 
ties of neural responses of different kinds are severely 'abbreviated here, and 
good knowledge of these would involve quite an intricate structure of interrela- 
tionships. 

An important feature of Fig. 20 is its inclusion of concepts from both Fig. 18 
and Fig. 19. The knowledge structure that we expect students to acquire is a 
synthesis of all three of these networks. It should be noted also that the 
knowledge shown in Fig. 20 should relate strongly to the student's general 
knowledge about neural processes, as well as general boncepts of anatomy and 
physics. 

f^rocess of Answering Questions ^ ^ 

Many questions can be answered by a relatively simple process of retrieving \^ 
factual information that is stored in memory. For example. Fig. 19 contains the 
answer to the question, ''wliich bone of the middle ear is connected to the ear I 
drum?" A process for retrieving facts from memory has been developed in detail 
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FIG. 20 Network of propositions nbout events Uiat occur when a sound is heard. 



by Anderson and Bower (1073); it involves entering the memory structure at 
components mentioned in tlie question (in tliis case, middle ear, bone, and ear 
drum) and searcliing for a match to a specified structure. If a match is found, the 
information is retrieved in the form of a propositional structure containing the 
aitswer required, in this example, the matciung structure iyould contain the links 
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(ISA malleus bone) (CONNtCT-TO malleus cochlea), and the answer would be 
"the malleus," 

The process of retrieving facts from memory can be seen as a kind. of pattern 
matching; in fact, the mechanism proposed in the preceding section for pattern 
matching m problem solving was borrowed from Anderson and Bower^s ( 19:73) 
discussion of fact retrieval. Some information resides in memory as a substruc- 
ture of a person's knowledge. A question is asked, and the question contains 
components', that match components of the stored information. The person 
retrieves the pvit tern, including components that were not in the question, and 
the new retrieved components constitute an answer to the question. 

Less specific questions can be asked, and their answers require some selection 
and judgment by the person who answers. ''What is the basilar membrajie?"* 
could be answered (from Fig. 19), "a membrane in the cochlea, connected to 
hair cells,'' or (from f'ig. 20), ''the thing that has a travelling bulge caused by 
pressure waves m the cochlea," oi- a number of other possibilities, including a 
combination of the two mentioned above. One thing a student must do is decide 
how much information is needed: ''tell me about sound waves," can call for a 
brief paragraph or a 30-page article or a book. Also, the degree of specificity 
required in an answer sometimes is uncertain, in some contexts, the question, 
"where is the basilar membriuie?" might be answered best with "in the ear," but 
in other contexts^ "in the cochlea" might be more appropriate (cf. Norman, 
197^3). Clearly, there are some important principles of social psychology operat- 
ing in the answering of most questions, in which the answerer applies assump- 
tions about the knowledge structure of the asker in deciding what kind of 
information is most relevant to the question. Tliis is understood well by students 
who often spend some time during examinations trying to judge "what the 
instructor wants'' as an answer to a question. 

One class of questions used frequently in exammations seems to raise a special 
set of theoretical questions. These are questions requiring explanations of 
.phenomena or relationships. A relatively simple example is the question-i, 
"explain how pressure waves in the cochlea produce firing of neurons." To arrive 
at an answer, a student should generate a sc^quence of comporients each involving 
a CAUSE relation. A mechanism like the one described for finding the measure 
of an angle in Fig. 8 would be/suitable. The process miglU start by setting a goal 
of finding an event that caii/es firing of neurons, then checking whether that 
matched the ''pressure wavt/s in the' cochlea" taken from the question, and if 
not, searching back further/ until a path of causal links had been established. As 
in the case of problem solving, successful performance depends b6th on having 
appropriate kntmledge structures and liaving an appropriate strategy for generat- 
ing goals th^it drive the pattern matclnng and search processes needed to obtain 
an a^iswer. 

• More complicated processes are needed for a question such as the following: 
"A recording is made of a performance on a pipe organ. When the recording is 
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played at high volume, a certain passage souiuls uniform in loudness, but when 
the volume is decreased, the h)\v and higli notes sound mucii softer tiian tlie 
notes in tiie middle range, R^xpiain wiiy tiiis occurs/' Lindsay and Norman 
{1^)72) present the information needed to answer tiiis question. It involves the 
fact that ioudndss is caused jointly by intensity and frequency; decreasing the 
sound level makes a very large decrease in loudness of low and high frequency 
sounds, but a smaller decrease in loudness at medium frequencies. 

^ The t'irst requirement placed on a student by the question about loudness and 

frequency is to comprehend the question. This requires considerable knowledge 
in the subject of psychophysics, and use Of that knowledge in a sophisticated 
system for constructing an mtcrpretation of the information given in the 
question. This is not the place to go into the theory of language understanding in 
detail', but recent contributions to that theory (Simon & Hayes, this volume; 
Schunk, 1072; Winograd. 1972) make it clear that a mechanism for under- 
standing a message makes critical use of knqy/ledge about the meanings ^of 
concepts contained in the message and relations of those concepts to other 
concepts in the person's knowledge structure. 

But beyond ct)mprehension, the stntlent who answers the question must also 
have a system for generating an answer that provides an .Manation. One of the 
things students need to learn is what counts as an explanation of something, and 
that is definitely nontrivial when the thing to be explained is a complex 
functional relationship. We do not have a theory worked out yet to characterize 
just what is mvolved, but it seems probable that the mechanism will involve 
•principles like those used by Abelson (1973) concerning the organization of 
belief systems and by Rumelhart (1975) concerning the organization of 
stories. The sfudeni must know that an 'explanation requires certain compo- 
nents. Most explanations either relate the explanandum to some general prin- 
ciples or describe a mechanism that performs in the way to be explained (I am 
not concemed here with the question whether these are fundamentally similar, 
or whether other kinds of answers can be explanations as well.). Thus, an 
explanatitHi is organized according to rules, and these rules constitute a schema 
that must l)e part of the student's knowledge. 

VVIien a schenja for "explanation'' is activated along with a structural descrip- 
tion of the relationship to be explained, a search can be conducted for relevant 
uiiMrmation in niemorv. 1 expect that the explanation given by many people 
. • would bo mediated by a giaph of eciual-loudness contours, such as the one 
shown m Fig; 21. A student who knows about the joint dependence of loudness 
on freiiuency and intensity could have that knowledge in the form of a program 
for generating a ^raph shuwing the relationship. To use the diagram, the student 
. would need further procedures for mterpreting the information produced when 
the graph was generated. In . this- case, a uniform decreascMn sound level 
.corresponds to a horizontal line moving from a high level on the graph down- 
ward for some distance. An explanation of the relative .softening of low and high 
fre([uencies would note that a decrease in sound level passes a greater number of 

O 

0 162. 



7/ COGNITIVE OBJECTIVES. 157 



loudness 



iritensi ty 



ency 



_ 




frequency (Hz) 



FIG. 21 Graph representing knowledge about the way in which loudness depends jointly 
on sound intensity and frequency, , 

contours at low and high frequencies than at medium frequencies, and this 
corresponds to a greater decrease in loudness at the extremes than in the middle 
range. . ' , 



Conclusion 

In this section I have taken up issues thdt are at the edge of available jthedfetical 
concepts in cognitive psychology. The theory of- semantic networks is quite well 
(developed and serves to represent knowledge structures of the kind we try to 
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teach hi niany expository subjects such ns psycliology. We test students' knowl- 
edge by asking them questions, and to perform successfully they are required to 
understand the t|iiestic)ns and generate apprc^priate answers. A substantial begin- 
ning has been made hi ihe theory of language cojnprehension, and some 
prmiiisiiig suggestions are available regarding generative processes in question. 
- answering. The availabk t'het)ries do nat tak'e us as far in this area as do the 
available theories of problem solving, but enough is understood to permit a 
rougli sketch t)f the kinds ^f prt)cesses that probably are involved. 

* , ^ ~ ' 

" GENERAL CONCLUSIONS 

My goal in carrying oiJt(: this work was to explote the applicabilUy of current 
c()nccpls and theories hi cognitive psychology to topics actually taug|jt in 
classroom instruction. The results have been encouraging. \ thmk we can assert 
confidently that (lur sttrte of knowledge and understanding in cognitive psychol- 
ogy lias now developed to the point where meaningful contact can be made with 
. the content (if uistruction. 

in this chapter^ the concepts and techniques of ctignitive psychology have been 
applied [o analyses of instructitJiial ta.sks. Task analysis has been a major activity 
of educational psychologists for some time, and Resnick's chapter 3 in this 
volume provides a review and discussion of instructional task analysis in relation 
to cognitive psychiiliigy. 

(^i;ireful attenticni to components of instructional tasks is potentially helpful in 
at least three ways, hirst, it aids .in the tlesign and evaluation of curriculum 
materials. Secondly, it,, constitutes u.seful knowledge for tecJiers who have the 
task of training students in the skills and understanding that are represented in 
the theoretical analyses. Third, it probably would constitute useful infjormation 
for students who have the task of acquiring the skills and understanding 
represented in the analyses. 

ASl impoitaiu (}iiesti(Mi is whether task analyses that' are more strongly em- 
bedded, in gcneiai psychological theory, as I have attempted to embed the 
illustrations developed hi this chapter, will be of increased usefulness in the 
•practice of instruction. It would be pleasant to have strong reasons for a positive 
response to duil ijuestiotu but it seems to me that such an evaluation must come 
Ironi Ihe potential users of the product not fn)iii one who proposes to offer the 
product tor use. A further impediment to enthusiasm now is the fragmentary 
nature of the illustrations of detailed task analysis based on cognitive theory. A 
more reasonable evaluatiiMi may be possible when we can display a relatively 
coniplele analysis ol tlie' knovvled^H* desired as the outcome of instruction in. 
some subject such as fi actions or geometry (m psyclu^pliysics. Perhaps th5 
. conclusion .can be drawn from the present work that it is reasonable to under- 
take such an analysis using ccMicepts that are currently available in cognitive 
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psydh>!o^'y. Of ouirse, we diouUj, expect that an etiort to apply current theories 
will shtjw sume needs tV.r changing the theories. But we have apparently reached 
u state n\ kruiwledi'.e and understanding that provides a reastmuble starting basis 
ioi devr»lopmerit o! instructional i)bicw'tive^ based nn general psychological 
theorv. 
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Impression Formation, 
Discrepancy from Stereotype, 
and Recognition Memory' 

Ray Hyman 

^ Univor^itv of Qrrgnn 



The backgriuirui !oi Hie researcli in tins chapter includes an interest in the 
"prepared nund*' (Hynian, p)04a). Under wliat conditions. Tor example, 

do preconceptions and prior knowletlge about a problem interfere with the 
restructuring necessary to achieve a sohition and under wluit conditions do they 
help? A particular form of this questitm is concerned with the role of dis- 
crepancy from pro t()tv pes in guiding the course of inquiry and contributing to 
the growth of knowledge (Brunswik, 1950; (Jombrich, 1961; Hyman, 1964b; 
KuhnJ%2;MischeL 1971), 

•Tlie motivation of the current research- program is to llnd experimental 
paradigms to study the opera tiiins ot schemata and disci epancies from proto- 
. types in science, art, and everyday alTairs. On the tine hand, such schemata 
contribute to distortions of reality,, missed discoveries, resistance to innovation, 
and o^her tendencies tt) assimilate new input to preconceived viewpoints. On the 
K)ther hand, they are necessary precursiirs to the rectignition of important 
problems, to the delection tif aniunalies, and to their own eventual adaptation to^ 
the disturbing. discrepancies. 

Althougii the experimental paradigm described here is directed primarily to 
such practical issues, hoib the paradigm and the questions it was designed to 
-miswer overlap with current research in psycho linguistics, verbal memory, and 
cognitive psychology/ This overlap might be taken as an encouraging sign of a 
narrowing gap between issues of iunv we acquire kru)wledge in the real world 
and issues being studied by contempiirary ci>gnitive psychology. 

The paradigm is based on the impression-lormation titsk used in studies of 
person [perception (Mastort. Schneider, . Polelki. 1970; Warr & Knapper, 

'The expcrimontal Jata \vt.-rc collected by J.uiet Pt^lt" and W. Irani Neill., who.also 
contrilnitod botli to the ilcsuni and tin; analysis t\\' the results, 
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hi tlie proseiit version, the subiect is presonteil with thcilescriptiDn ofn 
liypoihetKal uuiivulual (see Table 1 for e\ainplcs). The liescription amsists of 
the iKinie tii the uuhvuIiuiL the disciphne in which he is currently majoring 
(Accounting, law. ur Sucial Woik). ami a character sketch written around ten 
adjectives or tiaits. The subject's task is to rend the description, ibrni a coherent 
impression the itulivrdual described, and then circle those adjectives on a 
checklist that appropriately describe the iiuiivuluaL 

Alter nerlorming this task with a snuill number oV sketches, the subject is 
unexpectedly tested tor his memory of the actual adjectives used in the descrip- 
tion ol each hypcUhetical mdividiial. In the experiment to be reported, the test is 
tor recognition memory. I sing the same list of adjectives a,s was employed for 
the impression task, the subject now indicates which onc^s he believes were io the 
sketch of a given individual as well as his rated confidence in the judgment." 

I he mdeiHMulent variable in the present experiment is the degree to which the 
sketch of a hypothetical individual is discrepant from the sterotype of the 
categorv to which he i> assigned. The degree ofi discrepancy is determined 
operationally l)v havrug a normative sample of judges rate the similarity of the 
individual described in each skfi ii to (be stereotype fin each ()f the majors, -i^ 

Schrnnata, Prototype's, arul SttMPotypos 

We assume that our subjects possess v{/k7;w /a for the categories consisting of 
Accounting, law, and SiK'ial Work students.^ We view the schema for a given 
category as a system or set ot' criteria by means of which the subject can either 
generate or recogni/e instances that are members of the category. For the 
impression formation task, we hirther assume that the schema also includes an 
uleaLor representative instance of the category the /^n^^nnyu^ which is em- 
ployed as a standard against which new instances are compared, 

A schema {or the category-i^f Law Student, for example, would consist of a 
prototype o{ a tv])ical law student ahmg with rules and criteria that'^peclfy the 
tvpc and range ol permissible transloiniations that can be performed on this 

' f'ho literature on inemor\ iiulivatcs that the etteets that we want ti> explore within this 
p.tradit^m uill iiiosr hkejy s!uuv up m tree or eiied recall rather than in recognition niemory 
ui. Kintstii. IT/U) \;'ver{heless. we employeil onl> recognitiim inoniory in our initial 
evr>erMnefit. (hw t^wstm lor rhis cluMce was the hope th>U we could obtain maiiy more 
irUeri'sdiu' nulices *»{ hi»\\ the discrepant > trom stereotype in the initial descriptions 
cvj;ntnall> showed up in later rt cv»L'niti<»n. In our subsequent studies we plan to use reeidk or 
a c«JtnbinatiiHi ot recall ami rcwt'i^ntlion. 

' The coiuepl »«t *\i IkMnj'* has been used in ;i variety o[' ways and has actiuired a variety 
ot i(»nm>r.it!ons within flic field i»i p>\tlhdo!!v I lor esaniples see Altneave, 1957b; Bartletta 
19^, Ivans, 196"; N.>rlh\va\, 194fJ, Oldfielil, 1954, Keed, 1973; Woodworth, 19.18). In 
this chapter only stune i^i these varied connotations are intended. We m.ike no assumptions, 
ti)r example, jbnut hnu the scheiiiata orii^inate nor about the spcciiie mechanisms by which 
the> operate. 
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prototvpc. When a prototype for a jziveii cateuur> is sliared by iiienihers of a 
subculture, as arc the prototvpes for tlie riiajors used in tliis experiiuetit, tlieii we • 
call the piototvpc a stcranvpt'. 

Properties of tht* lmf)ros'3io'r Formation Tasl^ 

Tlic impression llial the subject tbrins on tlie basis ol a small set t)!' traitSrSeems 
to correspond cLoselv to Harriett's notion^of a sehema (Bartlett, Bartlett's 
use ol the concept oi ''schema" has been criticized as being vague and inconsis^ 
tent (Noithway, M^4(). Oldtield ^ ZangwrlL 1^)42). One problem is that what 
Bartlett was pointmg t(\ while real enough, is elusive and hard to describe. 
Rather than being a clearly delineated cognitive structure^ Bartlett^s schenui 
seems to be a ditYuse, cjuasi-affective "organized setting" within which the 
sub|ect tries to m.ike sense ot* material tti be assimilated oi to be recalled. 

Appaientlv. the subjects readily form impressitms on the basis of a few items 
id iiUormation af)out an individual. Because there is a great deal of uiter-and 
intra-subject consistencv m the impressions that are formed, social psychologists 
attribute an ''implicit personality theory" to their subjects. (Hastorf ct ai, 
107{)). These tmplicU personality thetiries. In the reahu of interpersonal percep- 
tion, seem to piay a role much like Schank's (1^)72) system of conceptual 
dependencies. 

What is ot interest tor the purposes of the present research is the fact that " 
subjects form' coherent impressions even when given information that is inter- 
nally uicmisistent/^ A rnajor objective of this research program is to study the 
differential etTects uptin memory tVf achieving such coherent impressions of 
inftirmation that vary in their internal consistency or compatibihty. Thus, we 
attempt to e\perimentally manipulate the degree t)f inconsistency while ensuring 
that the subject will be able to achieve a coherent irnpression. 

The adjectives chosen by the subject to indicate his impression provide two 
kinds of information about his ''inferences'' frtmi the description he is given, 
l-irst, they indkate the relative inlluence-upon the subject's initial impression of 
|he assigned n^ajoi and the character sketch.' Second, they provide a baseline for 
subsequent memory of the sketch. We can evaluate the relative intlucnce upon 
menior-> of those adjectives contained in the sketch and those used by the 
subject in his initial impression. 

/angwill ( l^^ '2) cites some 'studies which demonstrate that what the subject 
reproduces in recall depends heavily upini his initial response to the original 

"* \rror iMvnu' i «iiuiiit ti il Uns- fviH-nnu-u'. wo luivo discovcrcii that sul^jccts do not;rl\vays 
inrni .in ifUojTjfcd impro^sinn In »hf o\pcnnu'n! h\ ( Jothn (1^)54) less than nnc-fourth nf 
the sut>|tvfs jttcmj'tctl ( > inioirratf or ttrul .i mhercru. h.tsis lor iipparentty discrepant 
intornuuion ibnur a iMven pcrst^n. Ihc rcruainiriL! suli|t\ ts I tr ussed on one aspect of the 
intornuitu>n while ivinnnnt^ the distrep.uit aspect or iriehidod hiUl) aspects without attempt- 
in l» to rev on die rhom. 
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stnpulus. NtHthwny (1^)40) siinihirl\ nrgues that what the subject reproduces in 
serial repRHluctiou Uisks is iu)t the original stinnihisbut his initial perception of 
(hat stimulus. And the Russian psycholouist, Smirnov ( 1973) ctmcludes that the 
perception ul the original material prt^ceeds at two levels. One i.s the level of 
actual details and. the other is the level ot' a more abstract impression which we 
achieve in our etfort io comijrehentl the luatenal. This notion is much like that 
of the. schema-with-ci)rrection" theme as employed by Attneave (n)57b) and 
Posnor and Keele ( 1^70). The important point i^ that memory may be 
guidcil as much, if not more, by the general impression. formed at time of initial 
exposure as by actual content of the stimulus. 



METHOD 

Stmiuhjs M-jtfHJdh 

Tlie stmuihis m.ii rials consisted of three personality sketches, each attributed to 
a hypothetical indbvuhial. I*,ach sketch was written around a. set of ten adjectives 
selected «mi the basis of a normative stutly in which 12 judges were presented 
with a list ol [1 occupational majors such as Physical liducation. Accounting, 
law. Medicine, I-tc. The judges were instructed io imagine tne typical graduate 
student who would be majoring in each of these areas. For each such typical 
mai»«r. the judges went through Andersorrs list of 555 adjectives (Anderson, 
and circled each i)ne that they felt to he descriptive of that individual. On 
the basis of the agreement among the judges, six nonoverlapping sets of 10 
adiectives were selected tor tlie cimstniction tif six separate sketches. Fach 
sketch was written to fit the stereotype t)f a particular occupational major. An 
attempt was made to employ adjectives that were unique to a single major, that 
were not strongly negative on rated likeablene.ss, and fwr which a reasonable 
number of eiiuivalent synonyms existetl on the list. The three sketches used in 
the present study, each paired with the occupational major to which it is most 
appropriate, are listed in Table I. 

The perceived similarity of each sketch io each major was measured in a 
second normative study empkwing 5?> judges, all of whom were drawn from the 
same popuLition as (he subjects in the experiment. The judges formed an 
impression of the individual described in each of the .six sketches. Immediately 
after reading each sketch, each judge described his impression of the target 
person by checking the appropriate adjectives on a 200-woFd checklist. This 
2{)C)-W(ird checklist had been constructed from Anderson's list of 5.S5 by 
ohminaring tln^se ad|octives that were never or rarely used in the first normative 
study. A set i, defined as the normative impression for a sketch, was derived for 
each sketcfi from these initial descriptions, l-ach adjective that was circled by 
60'' or more of the judges was included in the impression .set I Ibr that sketch. 

EI^C 16) 
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TABLE 1 

Thf» SttfTiulus M iterials: The Three Pe(sonahty 
SV-jtches Employed in 



MiniAI I 1)1 ( Kl H 

Michael Decker is cnrruntly iUnny. izradiuite (vork in l aw. During his senior year in high 
sch'ooK Michael Decker's school counselor wrote the loUowing description ol liim= based 
upon interviews and psychological tests: 

Micliael u in ambitious person whii ot'teji is impuhivc and daring in hi.s thinking and 
actions. Heinii skoplual, he tends to be outspoken in liis opinions. He tackles problems in an 
aggressive manner. He is both talkative and forceful in his social interactions. Altliough 
possessed of a fiery teniperainent, ho is quite shrewd in his dealings with others. 

ROin Rl f AYWOOD 

Robert Cavv/ooil is currently doing graduate work in Accounting. During his senior year 
in hij>.li sthool^ H(»lu"r( Cavwood's school cmmstilor wrote the Tollowing description of him 
baseii up<in inter\iews .ind psy chologicak tests: 

Rolujrt IS bash ally i eautinus and thrifty perstm. His outlook is /«fl/mfl//5//V and his 
elassnulOs probably lerani hiin as insensitive In tackling any assignment he is orderly and 
thonmgh. Fiecause he is serinus tnd unassuming, he appears to be socially withdrawn. Both 
politicallv and in other ways is a eonjorniist. 

ANDRl W I I I MIV, 

Andrew I teming is curiVntly doing graduate work in Social Work. During his senior year 
in high school, Xmlrew I leniing\ school ct)Unselor wrote the following des.cription of him 
based upon interviews and psychological tests; 

Andrew is both a syann and idealistic person. Basically a ^n/;?^//;^ individual, he h patient 
and svmpathetie in dealing with people. His classmates describe him as generous and 
considerate. He is genuinely tolerant ni' other viewpoints and sincere in his desire to listen, 
Andrew readily agrees that his oytlot^k is sentimental. 

•^l ach skoti.li i'^ paired with the «k ciipational rnjjor to whuh it is most appropriate in 
terms >.t ludi'cs' ratin-s. The ten kc\ jdjct'tives are italicized in each sketch: they were not 
italici/t:d m the actUiil stimulus materials. 

Next, the lU'lgvs ilirectly rated the siiiiiliirity of tlie .sketch to the typical 
graduate stii<lciij hi each oC 10 occupational majors. The ratings were niade on a 
7-p()irit scale with "T" iiulicatiitg ''very similar" arid ''7" indicating "very 
dissiniihir.'' Note that that these ratings provide its with a measure for our basic 
. uidepeiulcnt variable' the 'Nimilarity-to-stereotype" for each possible sketch- 
nuijor conihuKitiuii. 

f inally,- the 53 judges indicated their impressious of* each of the 10 occupa- 
tional majors hy checking items on the 200-word checklist described above. A 
set M. dofined as the steiootype for a major, was constructed from those 
adjct'tives endorsed by more than ^0' ' of (he judges for a pven major. 

Viom these normative data, the three sketches and the three occupational 
majors to be used tn the present study were selected. Table 2 shows the 
combinations of tlie majors and sketches used with each experimental condition 
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TABLE 2 
The Major-Sketch Pairings Used 
ii; Each of the 
Pxperimnntiil Cnnditjons*^ 



Skeldi Name 



I'xpenrnentaJ 



ccinditinn 



( AYWOOl) 



l-LhMING 



\ 



ALCtnintmg (2.0) 
Social work (6.2) 
Taw (3.8) 



Law (4.1) 
Acniunlin^ (5.6) 
Social work (1.2) 



Social worM4.8) 
Law (212) ^ 
Accounting (4.6) 



\ '^Hic column^ indicate the sketch name and the row.s the experimental 

\ t.(>iuUtit>n. l ach eelj indicates the assigned major for the condition. The 
number'^ in parentheses arc the average ratings of similarity-to-stercotype for 
each major -skcteh pairing, "he ratings were made by judges on a 7-point scale 
such that indicates "very similar" and ''7" indicates **very dissimilar." 

aliMtg witli the siniilarity-rii-stercotypc rntings for each nKijor-skctcli combina- 

» 

The j{\djective Check List 

The construction and the coniposititni of tlie adjective hst, which is the constant 
instrument upon which all tlie iinpressiuns and recognition judgments are 
mapped, are very important, A new checkhst of 91 adjectives was constructed 
by selecting items from three sets the character sketch itself, C; tiie generalized 
impression df tlie sketch, I; the stereotype of an occupation major, M-appropri- 
ate to one of tliree sketches or the tliree majors. We attempted to get an even 
distributiini of adjectives among the subsets formed by the sets C, /, and and 
their ciHuplements. The greatest set overlap is between tlie stereotype for Social 
Worker and tlie impression lor I'leming (10 of 22 adjectives); the least is 
between the stereotype for Law and the impression for Decker (2 of 24 

Mdeall>, tlic arrangement ot sketches, assigned majors, experimental conditions', and 
rrlarivc sinii)ari!\ iti stert-dtvpe would forni ,i (Jreco-Latin square with each of these four 
l.utnrs nrih(>i")n,il In niic amilhcr. \\e could ridt .jlIucvc such complete orthogonality with 
the present set t>l thn-c skctclies and majors. In fact, out of the lota! set of six sketches and 
majors thai we started With, we eoiild torrn only (me balaneed CJreco-Latin square with a 
subset ol three. Ihif this subset hail undesirable features such as strong overlap between two 
(»f the skcti hrs anil a verv wide range »>t discrepancy in one condition and praclically no 
rani'.c \n di.trrpancv for ,wi other. Ihc sclcclion emploveil here is coriseiiuently a com- 
proiiusc. Uicrc is cnntoundiniT between the motJerate and extrx-mc levels of discrepancy in 
that Law is never p<ured with the nu^st discrepant ease in any of tlie three experimental. 
jL!r«uips while Aceountm.i! is paired ullh the most discrepant case in two of the conditions. 
The ctmtrast between the least discrepant case ami the other two levels of discrepancy, 
lU'WVVfr. »s i)rth«u»onal to the otlier three tactc^rs. 
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adjectives). The stereotypes for Law and Accounting share two adjectives out of 
a total of 25 between them. Table 3 may help to clarify what was accomplished 
in the two normative studies that supplied the sketches, the major^^ and the 
checklist for the present experiment. 

The checklist was constructed so that a number of comparisons could be made 
from subject's responses. Table 4, for example, illustrates the partition of the 
checklist relevant to the analysis of responses to the major-sketch pairing of 
(Fleming, Social Worker). Table 4 provides such information as the following: 
both Andrew F'leming and the typical major in Social Work are considered to be 
kindly and pleasant; Fleming is considered to be good-humored and broad- 
minded> but these traits are not part of the stereotype of the Social Worker. On 
the otiier hand, the typical student in Social Work is described as accessible and 
dedicated, adjectives which are not part of the general impression of Fleming. 
Also, even though the adjective idealistic is used in the sketch of Fleming, the 
rnajofily of judges did not check it as part of their impression of him, Later we 
will add two more cross paritions of the check list for more detailed analyses- 
one, includes the list ot adjectives included in the other two sketches and the 
other includes those adjectives actually checked by a subject as descriptive of the 
combination (Fleming, Social Worker). 

.» 

TABLES 

The Normative Studies and Their Yields 

' .. *3 

Study 1 : 12 judges 

Judges describe each i)f 1 1 occupational majt)rs on a 555-\vord checklist (Anderson, 
1968). 

ResuUs: 

(i) Six nonoverlapping sets ol 10 adjectives, each set appropriate to a different one of 6 
majors. A character sketch is written around ench set. 

(ii) A reduced list of 200 adjectives. 

Study 2: 53 judges 
Judges 

a, I)csicibe the 6 sketdies on 20()-word checklist. 

K R<ilc caih skctili tor suuilanty to stereotype of 10 occupational majors on scale 

lr<»in 'M" fvcry sinul.ir) to **7*' (very dissimilar), 
c. Describe each of the 10 occupati()nal majors on the 200-W{>rd checklist. 

Results: 

i. m)rma(ive impression set (^f .idjectives tor eaih sketch. 

ii. rated similarity of each sketch to each major, 

iii. stereotype set of adjectives for each major. 

f'rom tliese results, ^le tliree sketches and tlie tliree majors were selected and tlie 
91-word checklist was constructed. 
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TABLE 4 

The PartUion of the Checklist Relevant to 
Analyzing the Results for the Pairing 
(Fleming, Social Work)^ 



., ._ 












K. i «»i 






SLMitimt'nt.'il 




pa tien t 




11 U 7) 111 1^ 




sincere 








sympathetic 








tolerant 








warm 








considerate 


CIM' 


CiM 


rf\\f 


cnr 


pood-hunioreil 


kindly 


accessible 


accurate 




pleasant 


adaptive 


analytical 


trustwi)rthy 


sonsitivo 


dedicated 


careful 


hrn.ivl minded 


sociable 




cautious, etc. 


I Ihvrtul 


thouglitfiil 








acn'ptant 






conperativt" 


iharitahle 






omoticinal 


earnest 








friendly 








helpful 







^^C stands for the set of adjectives in tlie sketch for 
1 lemuig; / stands for the set of adjectives in the normative 
impression of this sketch; and M stands for the set of adjec- 
tives in tiie stereotype of St)cial Work. C*, /^ A?' stand for the 
cj)mplcments of these sets. 



Subjects. I'orty -seven subjects, taking iiiulerj»r;uhuite psychology courses, were 
asked {o participutc in an experiment on impression formation for which they 
wtM.iKl he paul S3.()(). They were tokl that the experimental session would take 
between 1 i to 2 hr. 

Proceciure. hacli subject was given a botiklet with detailed instructions. E:ach 
sul)K\:t cuuhl m) throiigh the entire experimental session at his own pace. Total 
time varied liom M) io min. The subject was told that he would be reading 
three brief sketches, each describing a different person, lie was to'form an 
impre'.sii)n of the person described and the^i record which adjectives on the 
accompanying lists seemed to fit his overall impression. He was to read a sketch 
{(u as long as ho felt necessary. He was to think about what the person was like 
overall. Once he felt he had fj^rmed an impression of the person, he was to turn 
the page to the list of adjectives. Without looking back to the sketch Jie was to 
read down the list of adjectives. Wliencver he encountered a word that seemed to 
fit his idea of what the' person was like, he was to circle it. The subject did this 
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for each of the tluee sketclies in turn. The instructions were repeated prior to 
each sketch. 

Upon completing the clieckHst for the tiiird sketch, subject came upon the 
foilowing instructions: 

In the 'tirst part we asked ynu to iuim an inipressum ot a person on the basis of the 
deseriptiort we supplied to you. At tliat tune wc did not tell you that you were to 
remember any tiling about the description. But in this second part of the experiment, we 
are goum lo ask you to remember a^ best you can tliose adjectives that were actually in 
the descriptions ue supplied to you. We are aware that your ability to recognize that an 
adjective wun «>r was not m the sket*.h of a given person cannot be done with absolute 
certainty. 

Detailed instructions about how to employ the 6-poim rating scale followed. 
For each adjective, subject was to circle 'M" if he was very confident that the 
word tlid appear in the sketch; ''2" if he was reasonably confident that the word 
did appear, 'VV* if he was slightly ct)ntldent that it did appear; "4" if he. was 
slightly confident that the wt)rd did not appear, etc. We did not allow a neutral 
category on the scale because DUr preliminary experiments indicated that sub- 
jects tend to overuse the middle catogtiry, 

^. The subject then turned the page and encoimteretl the list of adjectives 
with the rating scales beside each one. At the very {op of the page was the name 
and major of the majt)r-sketch cumbinatit)n that iie was trying to remember. 
When he completed his ratings tor one sketch, he turned the page to a repetition 
of the instructions in case he needed to refresh his memory for them. He then 
turned the recognition task i\n the second sketch; and then finally to the last 
sketch. 

The evperiiuent was conductetl in a large classroom with the subjects seated 
such, that all could be monitoretl by three experimenters who were present 
.throughout the session. 



RESULTS 

/The results are based upon the data from 44 f)f the 47 subjects distributed as 
' folh^ws: 14 in Condition A, 15 in Condition B, and 15 in* Condition C (Three 
siib|ects tailed tt> iolhuv mstructions). 

The Impression Formation Task 

Figure 1 snmmari/os the data (d how the subjects used the checklist categories 
to describe their nnpressitnis ot the sketches. The categories C (the sketch 
adjectives), CI (adjectives m normative impressi()n, but not in sketch) and K 
(adjectives in the lUher two sketches) and Base lall the remaining adjectives) 
_were employed because they consisted of identical adjectives for a given sketch 
and all three category assignments. The data are pooled acrojss the three 
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sketches. The first value on the abscissa is tlie average ^iiniilarity-tD-niajor lor the 
3 cases in which eacli sketeli was assigned to its nuist compatible major; the 
second value is the average tor the 3 eases in which each sketch was assigned to 
its next most cnnipatihle major; the third point is the average for the 3 cases in 
which each sketch was assigned to its least compatible major. At all three levels 
of similarity-to-sterecitype. subjects use about 80',; ol the adjectives that were in 
the target person's sketches to describe their impressions. Almo.st as frequently,* 
they employ adjectives that are normative associates of the sketch (category CI). 
The *'baseline" category tejids to elicit somewhat more usage than do the 
"adjectives in tiie other two sketches. This is partly due to the fact that the 
baseline contains adjectives in the stereotype categories and. for each sketch, the 
adjectives in the closest or more appropriate stereotypic category tend to be 
en.iployed in the impression task with almost as much frequency as are the 
ailjcctivcs in the CI category (approximately 70^' as compared with approxi- 
mately 75'). 

I'igure I sliows that subjects do tend to use the adjectives from the normative 
impression in in.iking their own descriptions of the sketch. It also seems to indi- 
cate that the descnptrons were allected very little by the degree of discrepancy 
from stereotype. Figure. 2 shows tlie lendency to employ adjectives during the 
impression formation task that come from the three stereotype categories on 



100 



r 




60 



C ADJECTIVES IN SKETCH 

I NORMATLV^ ASSOCIATES OF SKETCH 

K ADJECTIVE^ \N OTHER 2 SKETCHES, 



^ 20r 




2 3 4 5 6 

AVERAGE SIMILARITY TO STEREOTYPE 



FIG. 1 Ptopurti«>ii ol nvos scUn ttul Inun v.uioiis cjtL'giuios {>!' the checklist (luring the 
iniprfssion-fnrnKJtum task. Ihc sirmlanty-t(vstcrt'<>5 p<>' alonu the ahscissa is based on. the 
averaiTcd normative ratintzs ti)r the three sketches, al each n\ the three jcvcis of relative 
discrepancy Irom stweotype. The normative ratings are on a scale ranging t'rum very 
similar to the sterc«^type ot rhe assi^ined catepor\ . to " 7/'' very dissimilar to the stereotype. 
J ai h pi>int IS based on the data trohi 44 subjects. 
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1 'OOr 

L LEAST APPROPRIATE CATEGORY 
.2 M MOST APPROPRIATE CATEGORY 

2 N NEXT APPROPRIATE CATEGORY 
I 80- >^ INDICATES ASSIGNED CATEGORY 




AVERAGE SIMILARITY TQ STEREOTYPE 



FIG. 2 Proportion ol adjectives selected from the three stereotype categories on the 
eticckhst during the nnpre'ision lorniation task. The abscissa has the same meaning as in I ig. 
I. The arrows indicate the assigned category. 

the checklist. ^The top lino on the graph, for example, shows the tendency to use 
adjectives in the most appropriate category (the stereotype which is closest to 
the sketch) when that category is the assigned one and when it is not. Here it 
looks as if the tendency to use adjectives from the appropriate stereotype is 
greater when that is also the assigned stereotype. Although this is a reasonable ^ 
and expected finding, not too much reliance should be placed upon it because it 
is mainly due to one sketch. 

With one exception, the tendency to use adjectives from the various stereotype 
categories seems to be determined almost entirely by the similarity of the sketch 
to the stereotype rather than by the assignment of the sketch to a major. The 
exception is for the intermediate case, in this latter case it does appear that 
assigning a sketch to a major that is moderately discrepant (rather than ex- 
tremely discrepant) does result in an enhanced tendency to use adjectives in this 
category to describe the impression. Although this finding of some assimilation 
to the stereotype for the moderately deviant assignment is consistent with our 
predictions, the effect is rather small and local (in the sense that it does not seem 
to affect other categories of the description).'^ 

Subsequent analyses i)t individual adjectives and a replication evporiment with a much 
larger sample confirms tlie fact that the assignment of a major to a sketch affects both the . 
impression and the recognition task. The analysis by large categories of adjectives masks this 
effect because many of the adjectives do nui discriminate because they are easily rejected as 
being irrelevant to a particular sketch. 
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The Recognition Task 

The dcpciulciU variable t'nr evaluating the subject's recognition memory for the. 
adjectives iti the sketches is simply ih^ average rating fur the various categories 
ot adjectives. 

i-igure 3 siimman/es the basic results on the rect)gnition task. As in the 
preceding two figures the results are displayed as a function of the average 
similarity to the steret)type. Here U)o, the Telative discrepancy betw<^pii sketch 
and assigned major has little effect. 

Figure 3 displays ihe recognititm ratmgs broken down by the six tategories. 
hirmed bv splitting each ()f the three categtiries C (sketch adjectives), C/, and 5 
(baseline), into those adjectives used by .V in his own description (/)) and those 
not used in his own description (/)). For both the D and the /) categories, the 
subiects consistently tend to rate the adjectives that were.actually in the sketch 
as mtjre likely to have been in the sketch than they do ihe adjectives in the 
normative assficiates (CY). In Fig. 3 this effect is larger for those adjectives in the 
subjects' descriptions than for those that are not. We do not consider this 
interaction "sigmiicant however, because it is due mostly to one sketch. an'd 
dties not e\i^:* in the other two. 

■Ihe uoinuitive associates, in turn, tentl to be rated as more likely to have been 
ill the sketch than the adjectives m the base set> This effect is approximately of 

* r C SKETCH ADJECTIVES 

I I NORMATIVE ASSOCIATES OF SKETCH 

; 0 ADJECTIVES IN Ss OWN DESCRIPTION 

i 8 BASE SET 




^! 2. 3 4 5 6~ ^7 

AVERAGE SIMILARITY TO STEREOTYPE 

FIG. 3 R^M 'itnui'^ri : itipj .is a !nru n^n ■»! jvor.irc (I*'vijtiiurt"rt»m stert'ptypc. The ordinate 
r•;prcscnt^ Uic r iTitu* scale whkU ranjifd tr<»ni '1." vcrv (.ontidtnU tliat adjective Was in the 
skcrch, throui'ii verv riuUidcnl that ,ui|ec tive was not in die sketch, laeh pc^jnt is based 
i'H fhc d it.f tr ^r?} 44 Niiliit^tv. 
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the same size for both the adjectives used. by the subjects in their descriptions of 
the sketches and t'or those not used in their descriptions. Finally, for each of the 
three categories, the adjectives actually used in the subjects' descriptions of their 
sketch impressions tend to be consistently rated as more likely to have been in 
the sketch than those not used by the subjects in their descriptions. 

Figure 3 suggests, then, that. the. recognition ratings can be explained or ^ 
accounted for by three approximately additive main effects. One effect is due to 
the adjective actually having been in the.^ketch; anotfier effect is due to tlie 
adjective being a member of the impression of that sketch generated by a group 
of judges; the third effect is due to the adjective being one of those actually used 
* by the subject in his description cf the immediate impression he formed oPthe 
sketch-major combination. Our analysis of variances on the three sketches 
Confirms this impression. The reader should compare Fig. 3 with Fig. 1 to note 
how closely the recognition data mirror the descriptions made during the 
impression formation task. 



DISCUSSION 

This chapter examines one of a contemplated series of studies that will explore 
the usefulness o^' thei, impression-formation task as a i5^radigm for investigatirig 
issues related to the restructuring ofomemory and the acquisition of Icnowledge. 
Two issues of concern in the present experiment are the role of the subject's 
immediate impression upon his subsequent memory for the sketch and the effect 
of as.signing the sketch to compatible or discrepant majors. The data suggest that 
neither the subject's initial impression nor the major to which the hypothetical 
individual was assigned have any appreciable affect upon his ifecogrlition memrry 
for which adjectives actually were included in the sketch. Instead, two approxi- 
mately additive components appear to determine the subject's tendency to judge 
an adjective as having been in the sketch. One component is whether or not the 
adjective actually did occur in the sketch. And the other component is whether 
the adjective belongs to the set of normative adjectives that judges have checked 
as characteristic of the individual described in the skefch. . 

The analysis of variance indicate that the subject's confidence ratings can/be 
* accounted for by three addftive main effects. One niain effect results ffom/the 
adjective's having been in the sketch. The second rewilts from the adjective being 
a member of the normative impression set generated by the sketch. The third 
main effect is due to whether the adjectiv? was or was not in the subject's own 
immediate description of the iinpression created by the sketch-maioJ><:DTnbina- 
tion. . ' 

The hick of any interaction between the checklist catego/ies andjthe usage of 
adjectives in the impression task along with the parallel outi:omes from both the 
impression and recognition tasks sugges^ts that *we have two oependent variables 
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v.lftcii h >*h u'tivvt 'ris; ^dv.v.' 'tii^lN. I!?.' t ict rh.i? oru- ik'ivriiiriit '•siriablo is 
-hf.ui!; .! pn f.' the 'f!uM uppa^'onlK .iocs no! have any ollcct on tiic outcinne. 

» ' '• ;r';5ri/' m Mu" p;'%„.\lHU! parai.^:aphs wa.i not mloruled to 
iiuhc.ite .1 r. ihjv. While it nuke .scn^e t » view the occurrence v)f an adjective in 
riu' stiiniil i ; skf»tc!i as ''ca'i^nu'"* an itu r^nneni in recot»nitii»n tneniory for that 
a.iicctivO, It !'3ake>. unwU lev, cerise lo (:eat tlu^norniative catot;orv nt" adjectives 
\h the >*\etch nnpressio'i a^ a causa! aj*ent. Presurnabiv tiie adjectives in the 
.ket. h ,ause flic s ibiojt to u'ein?rate or retrieve a cateitur\ or sclierna for 
uJ v. ru^iUi.' tlie iiidrvui'ial ;h the sketch, Iliis personal category or impression then 
!h ori}e > tli ' ^ Miu c causal at^ont tor increasing: the subject's tendency to 
ralveU ie^«fj.Mii/c an ad|ective a> iiavuir Iwn ni the sketcii. This personal 
inir^^c^siot? IS partiallv correlated with both the normative impression of the 
and wuh the subfect's ch^uce uf adjectives in the nu]iression task. 
Ir I. [J**, abl- thai the erlect ot the subjectN immediate impression of the 
ili:> umhi up in iccoiMiition memory with a longer interval between 

JniMiiu . pi'v. -r rati-ni and subsequent testmg tor retention. As mentioned in the 
'lirouiiK " i.. .»v.>ii m ^re IikeK tliat such. an ettect will show up in recall 
' ifhiT than ?e.'n/MrtMn. I he data on me!no;y lor visual toinv (Riley, 1962)and 
V tnoa> attt'iiipts tu j>'phcate and elaborate Hartlett's work (/angwill, 1972) 
Hi'.hvare rha! jepi-Hiuction and recall are heavily mriueneed by the subject's 
Htitial ^evp*«!ne to a stimulus but tliat lecoiirutiori menu)ry may or may not be a 
t.in-.n^'li.oi tlU ' iiiithtl reaction ' ' o 

Ihe TI^».t ;riip*Mtant result is the tact that recognition memory seems to be 
s^vMni^lv iiiJlneTicC'i hv two approxunatelv additive components. Possibly there is 
ilv* a >hi!iif !ntlu*M!ce <>r the stereotvpe ot the assigned majnr, Future studies will 
ii ve fi.Mfe hi»w these CMmpoiients tare fver longer intervals of retention and in 
t Mfifs t»t t»ther ludkcst't letetition. [ rom the worK on pattern recogmtion (Hytnan 
I i v^t. 1*^ P ^.iicH vV Keele, MUiH,. 1O70) and from some of die work on 

ernantic riieii^orv (H.iichn, P>'^/». Brans* »rd, Barcley, Sc F-ranks, 1972; Braijs- 
I lil \ f ranks. {Wj ) wouhi evpect (hat with increasing retention intervals 

t ]b\[\un m/inMr\ lo.iJ . (he mernofv oi the specilic ailiectives or details of 
rh':- A.'f. h v.itnl] I ide to of {n a nei'hgible level while the tendency to base 
th'-' rnem.^r> upon the general impression will remain stable. The so-called 
"rev''ii>rnKfr»c". i>pevMs n\ the meniorv will then dominate subsequent rcien- 
n..»i Wherh*! rf i, hitter resul^rs seen as a detect or a virtue o|' memory will 
^ prn ! .ip'vri fh- f,i j- mil tit-' iu\ih set by the*e\perinienter, the educator, or the 
.-'i i r^r p Ui'! f .ni!,' -ttUt' that m tlie patter n recognition studies it is 
. "i,'-hier.?d ,t ;ir?ue u* rcspviud m fejms ot a generalized impression or abstracted 

r 't;,i •.. 1, u p i{ h tu- ' uTif^K t. i! ,1 new sr(iU\ rn \\ \\wh we 
'•w'h.h -n. isif' .. I U • .jH s-'m.'-. shi.u flu^ saiTK- p.iMcrn «»! results 
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image, whereas in rea)gnititni--memory perti)rmance is scored in terms of ability 
to discriminate tlie actual details From the general impression. 

Our mainpulatiDU ut discrepancy from sterei)t\pe represents only one of many ' 
possible ways io manipulate discrepancy. (Jur nuijors "Law Student," "Account- 
ing Student,'' and *\Social-Work Student" are by no means mutually exclusive. 
The set oF adjectives in the stereotype I'or an Accountuig Major include descrip- 
tors such as '^analytical," "careful," "consistent," "methodical," "systematic," 
etc, Almt)St all of these descriptors seem to deal with work habits and ways of 
coping with problems. Not a smgle adjective in this stereotype list for Accoun- 
tant refers to interpersonal relationships. 

The adjectives m the stereotype for Social Work major, on the other hand, 
include sugh descriptors as "accessible," "adaptive," "acceptant," "charitable," 
"friendly " "helpful " "kindly," "sensitive " etc. With practically noPXivptions 
these traits all ileal with interpersonal relationships. Thus, there is no incom- 
patibility between the stereotypes of the major m Accounting and the major in 
Social Work, In tlunkuig of an Accountant major, one does not typically 
consider his interpersonal relat' >nships and vice versa. But there is no reason 
why an individual cannot sunultaneously fit the stereotypes of a student in 
Accounting and a student in Social Work. 0|ie way to create true discrepancy is 
to work with mutually exclusive categories* or to deliberately construct sketches 
which contain adjectives that are antonyms of those adjectives that describe a 
given stereotype. 

Another related problem with t^ " categories we have used is that they are , 
quite broad 'n their inclusiveness, ur hypotheses about relative discrepancy 
from stereotype were based on the idea that the category of each of the majors 
was bounded in the sense that descriptions of individuals who were quite 
different from the stereotype would be vi. wed by the subjects as definitely not a 
member of that category. It was hoped that the sketches that were intermediate 
in similarity to the stereotype woi'ld be seen as quite different fronx the 
stereotype but still within the permissible bounds of variation from it. Actually, 
our categories seem to be relatively unbounded. Although the subjects do seem 
to jiave coherent and shared ideas of what the typical or prototypical student in 
each occupational major is like, they also probably see these categories as 
relatively unbounded in that any sort of student can choose to major in any of 
thes'e areas. Possibly we would have more clearly bounded categories if we 
assigned sketches to the actual occupations rather than to students who are 
training for tluu (Occupation. 

Still another reasof? whv the assigned major had little effect upon the impres- 
sion and the recognition tasks might be the fact that the sketches were written 
so as to be mternally coherent and coht*sivc. The sketches generated a consistent 
impression of an uuiiv'idual without any help from the assigned nrajor. It is 
possible that the assignment will have a noticeable effect only when .the stimulus 
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wuvie. ainbigiUHi>. nr inierually vontraduiury (cl. Firanstonl A: JuIhimmk 1^)73 
rt»f ft'! ire! cvrkMicc). In the studies of Inhclina arui nioniory ti>r visual form 
U<iV/>. 1*^(^1) the siunulu^ « objects arc tvpically amhigiunis. 

A inai*>r purpose this chapter is li» indicate the pronvise oi the impression- 
h»rniatinn task ar» a paratligm for the experimental uivestijiaikMi of a variety of 
questions related to the restrik tuiint; t»l meniorv, the aeiiiiisition ot riew infor-, 
niation. the asMmilatum o! new inputs to existing representations, and the 
accnmrnodution of exwtrii: representations to fit the new inputs. From our 
piehminary expernnents arul fr<im our experience with the experiment discussed 
fieri', 'vve are encoiiraiied bv many features of this paradigru. For one thing, the 
subjects say that tiiev tuid the task meamngfu^ and quite relevant to their daily 
activities. For another thing, individual behavitjr is surprisingly consistent and 
^vcll piedictctl from population norms collected on moderately si/ed samples. 

I Mriv' rhf samr stimulus materials and paradigru, we plan to study the effects 
u?} -uher iriili-j's ^\ menuny such as recall and the effects of longer retention 
intervals. Oth-r extensions of this work will involve changing the manner of 
mampulatini' ii^t fcpaiKV fiom prototype as well as changing the stimulus 
tnafcriais [mu example, wc [)lan in make sketches internally ambiguous in the 
•eiue that the adjecMves used wili be thavvn lunn two or imue different 
>fLre*»t\ p«.N. Tlie as.uuuncnt oj rho sketch to one or the other of potentially 
relevant catCi.'* uies should result in relatively nu)re emphasis on the relevant 
Hiif^sef ot adjectiv^N both in tinnnng the unpi 'ssiiui and in subsequent memory. 
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Ctmsuler what happens when a pcrstni learns a complex subject matter. By 
ctimplex,. v.e mean something that takes a considerable amount of time to 
learn time measured in weeks and months, not in lu)urs or dijys. Complex 
topics contain a large stiucture of informatitm ct)mposed of the relevant con- 
cepts and processes that make up the topic. A large amount t)f time is necessary 
just to incorporate such a niass of material intt) a person's memory structure. 
Moreover, sheer rtUe ac(|UisitKni of the concepts is not enouglu The material 
must be structured in such a way that relevant concepts can be related properly 
io one another. The pr(>cedures must be learned well enough that they can be 
perfi)rmed when neciled, and more important, so that they can be performed 
whe!i tho situation is ni)t quite the same as when the ct)ncept was learned. 

Betore wo can make much progress towards the understanding of how com- 
plex topics are learned, vve need to know about the organization of knowledge 
withirV human memorv. We cJontend that our relative lack of knowledge about 
the Icarnmg process is a direct rellection tif our relative lack of knowledge about 
the structure o{ human meruory. Things are changing, however. Psychology is 
now cxnning to understand memory structure better. In turn, we are now 
...starting to get a better understanding of the process of learning. 

In this chapter we exanune some current ideas ab()Ut memory structure and 
show their relevance toward the study ol learning. We discuss the organization of 
basic memory units around frames or srhrnuJa and more especially, the way by 
which a person ctmies to modify these units. Tlie overall result of this endeavor, 
to us at least, is both exciting and disapp()inting. It is excitmg because it appears 
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tu slh'W iMw r-aMU vvnfk in rh'.' stuJ\ c'tinutiv>' >>>ton!s ^an poterUially ho of 
vahiL^ ti> liii .Ifcpof uiulcrstaiuiuii: tiic problorn^ inv(^lvod iii cducnlion. It is 
ilr..at.pon:fr':\ hwiii-/ ^\ l' are it cai! he ^aul that all liiut lias boon 

a^iM!!tpli,iK\i is tiic siahMiKMit Mt kfi.»\vleil|.'c and uiulorstandirig iiitn a new 
rertmn.'l,,:»% . Despite all this, we ate Mpuinistie tliat the new terniinulogy, 
co'.ipIcJ. with oiir- liiuiersrarjilint' i»! ^«n»nitive pmcessOh can eventually leaii to a 
deeper tiniterNtaii'liii:', ft iearnuilv 

A !■ iT.'ifK.'i w-nkeis ui the iiekl »)t human memory have rocciilly been 
de'.elMpin;' t-^niuil f*-j>iesentatioiis for the knowledge within memory. Most of 
.th'- fnodels that w- are mteresteirin here are deserihed as scnmnttc neworks. 
I-.11<'WH1L* fh- vv-rk Qmllian (l^XiS), ihev are all eharaetori/ed by a directed, 
labeled I'r ipli liue. Mich a«, those sh<iwn iT Figs. U 2, and ^. We call our 
ver>iofi ot a sematific netwnrk .iniW/irc stniciund network to emphasize that the 
fcpresenfafivjn is both aetise and passive. It^can eontain general procedures that 
ean l>e eveeiited whenever }uiKti*>nal knowledge must bo used (This work is 
rept»rteil in Norrhan. Rumelliatt. and the I NR' research group, 1075: from now 
MH we reler to this work as '^INR"). Although we will base our discussion on 
{\ns wtuk tiie cninm..mfs will applv to all semantic. network representations. 

haNicallv. (lie semantic network ^ntnules a means of representing knowledge. 
Ir Is a new t^.)] m psychology, Previoiislv . our formal models have been abstract: . 
.1 matheniaticai leartiing model, tnr example, talks of the probability or the 
Ntiengtii of sotue association betwceti two elements, but the elements are usually 
part ol a large homogeneous set. With semantic networks, we look at the 
structure ot very particular iteniv 

Thf- InfMrnai (^>aip(jn»*nt\ i;t V^'rlj'. 

Consider, for example, how a chikl might' c^nme to learn language. In the work of 
the I NR rese.irch group, the meanings id verbs can be decomposed into 
underlviri:' pinmiive rk'nu-nfs. fhus. some verbs specify only STATIVI- com- 
pofrcrn.. .if) f-; .ifc more coniplex, specilying CAl Sr and ClIANCU:. When we 
sav that, 

i I ) I he ski''! went t(» the top ti» the nn-untain. 
there ss .» . hartLV «»t locati^i, < ,| (kr skier ,j > show n in I'lg. 1. 

Ih'.» ri) tnn 1 NR reprcsonN it-^cvji' ii I'rujp .\t tlu* I niver^itv ot ( aliiornia. San 
Uict:..* Ahi..n has stiuik-d !h.Nt> {ssiie. Iht- ^-r-ap u.ts orii»in,ttjv t<^rnu\l and suporvjscd by 
P-ti'M iv4s.i\, \) tmM \, ni in. irul WxwA Kunu^Ilijr J. luni.v. \ NR. 



\). SCHEMATA FOR LEARNING 179 



/ 




The tliTu re shows Wv' dfcuTiposiliiin ot the verb "went" into its more basic 
iiiideiK irur cnnipiMKMits. i.e., its iietwcnk structure. Netwt)rk structures are 
conipostnl of nodes and ordered, lal)eled relations ct)iniecting these nt)dos. In 
F'ig. l/the t)vals represent inotles that are token uistancos of prt)positional 
btructuros. the . angular brackets (e.g., skier) represent nt)des that are token 
instances uf concepts, and the phrases enclosed in quotation marks (e.g. /'bottom 
of jnountain**) represent network structures for the concepts described by the 
phrases, hut which we have niU sluwn in detail in the figure in t)rder to maintain 
the chirity ot the duigrani. In the l.NR active structural network, thde are l\)Ur 
different types of node structures, two of which are shown in I'ig. 1. The 
mnnhers ot the t(»ken pioixjsitional mides have no meaning: they arc used solely 
to facihtate the discussmn of these nodes. ' 

F'igure 1 can be interpreted in a straiglitforward manner by starting with node 
*1, the oval hd)eleil CHANCiH. This indicated that some change of states has 
taken place; (he icLitions leavin; nt)de *1 describe the states that are involved. 
The CHANCfi takes place from a state shown by the node *2: Tins node says 
'tiiat its. subject (a skier) was located at the ''bottom of mountain" from some 
unknown time tu st>nve time not specified (but indicated by the unnamed node 
shnvvn as angular brackets). Th-^ result the change is the state represented by 
node *.V the skier is now as loci'Mon -'top of mountain/' Notice that the time he 
was located at the top of the niountain is not specified, except to indicate tliat it 
IS later than the time at which he was no longer at the bottmii of the mountain. 

\ more cnniplex verb is one that implies causahty: say "to give.'' If we say 

(2) Su/iMtt* f.'nk the skis Irom Hcniy. 

we mean tluit Su/ofte did something that causeil the skis to change from 
Flenry's possession to her possession. We illustrate this sentence with the struc- 
ture shi)vvn in f ig. .\ 

Er|c 18 i 
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FIG. 2 Su/iutf tt)ok the skis from Fienry. 

Nt)te tluit these structures prnvide fnuneworks for subsequent knowledge, 
f.acli structure is a memory schemer it allows us to organi/.e the material that we. 
learn lateron. Tims Jt we learn that 

ilil) She promised to return them by morning. 

' wc know that there is an obhgation to return Ihc skis. From that we can deduce, 
that she got them from Henry with his permission, and in fact, we expand the 
framework Tor the knowledge to something like that shown in Fig. 3. Note that 
we add the new knowledge directly to the framework for the old. Not only did 
we have a convenient way of moditylng the structure for. the previous episode 
acct)rding to the framework provided by the schema for the first sentence, but 
we have now modified the structure into one that is equivalent to "borrow." 
Su/otte honowed the skis. It ts easy to sec how odier statements could have 
modified the structure to indicate that 

• Suzette stt)le the skis (no permission was granted) 
^ Su/eite purchased or rented the skis.(she paid .money for them) 

Su/iMte ivM the skis by askint^ Peter to pick them up for her (expanding the 
DO statement). 

DevHiopmentdl Studies 

The schemata pi'{)vided by this torn; ot structural analysis turn out to be rather 
pt)werl'ul.. Dcdre Centner (1975) shows how a number of the verbs of possession 
can be analyzed in this way: .More important for present purposes, she reports on 
experiments which show , that a person's memory of the actual verb used in a 
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FIG. 3 In shadril Su/iMto f u-k ski^ frum flonry. A>>r shadrd: Sln^ promised to 

j-cturn thoin !n t.vrMt»rr>nv I^iud strut titrt- Su/oMo Ijorrnwod skis fmin Hcinv proniisiiu^ 

sentence will vary systematically with the other information provided, much in 
the manner of the iHust rat ions wo have already provided. 

Centner has also stmhod the order in which these structures are learned. If we 
look at Vhy 4 wo v:c the underlying ccnnponents that she has analyzed for the 
structures o!' the verbs '*iJivc. take, huy, sell, spend money, trade," (ientner 
shows, how one can derive an ordering for the acquisition of the underlying 
components, ami tlieretore lor the verhs themselves. In fact, she has performed 
the necessaiv ex[viimonts. She seated children m front of tables which had two 
dolls (Bert and I rnie) and she asked the children t(^ make <^ne doll huy, sell, give 
and take toys frvim the other. The details are reported in her paper, but the 
important aspect is that the developmental seijuence of acquisitiim followed 
the oxpectatinns rather nicely. See f'^;^ Yon might note that the structures of 
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FIG> 4 Iho rcKuiufiships duuMw. the concVpts undcrlyinir the verbs "give/' "take," "pay/' 
"hiiv/' '\e!l/\ind 'Npeiul money." Uie sciuaiUic components and the states that permit full 
uiKltTstamlinr M the vorhs are a-presented by (he shatkd ovals. Age ol the acquisilitin ot* the 
vorh^ pr'Korils v-rfp allv, N uiiu-cst atie at the top. (I rom (K-ntner, 1975.) 

these verbs are re.istuiabiy complex. The time coarse of the acquisition of the 
verbs bjlh^ws ilie tfioretical iirdenng of tlieir complexity. It takes children 
approxiniately 5 years (f) [uogrcss Ironi tlic state in whicli tliey use words like 
"give'* and 'Uake'' properly to the point where they use the entire set of 
possession verbs shown in Fig. 4 properly. The structural network descriptions 
for these verbs show why this Uuig time period might be necessary. Children 
nuist learn about a luunber ot ditlerent concepts some deahng with social 
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FIG. 5 I'r<»lvihii!ty oirroi ! use nt vorl> versus a^o i^l chiKIron. (I rt>m Ciontncr, 1975.) 

conventions, some dealnu! vvitli language, and utliers dealing with the physical 
properties of objects and locations. All these concepts must be understood, and 
then, tor the proper linguistic labels to he assigned, they must be interrelated in 
the manner sht)wn [)y the network structures. Once the schema for the inter- 
-nrelatums is acquired, then the linguistic use can be appropriate to the situation. 
Note that the schemata captifre the Interdependence of nonlinguistic phe- 
nomena. Concepts such as OBIJG.ATION, C'AUSF. and DO are not verbal or 
linguistic concepts: .these schemata ami tlie network presentations are not 
restricted t»» lim^uislii coucepts. 

We could iX^y <»n. hut for preseiit purposes it is lun necessary. Suffice it to say 
that It is possible to demonstrate liovv similar structural representations can he 
formed h>r visual scenes (Palmer. I'^^'^S^ in the LNR vohmie) and for stories 
(Rumclhart. l*r^S) 



The Structur^: of Schmtujla 

A schema provides a frameworK on which to interrelate different elements of . 

information ahtjut a topic into one conceptual unit. 
A schema consists of statements about the important features of the unit, th'e 

functions of the unit, rules tor selection and rules for use. 
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. Functional schemata will often a\ntaiii a conditional statement and sets of 
events tliat are to bo perfonned\according to the status of the conditional 
slate, \^ 

The Seluction of Schemata \ . - 

Schemata aie selected tor use acctirduii;^ U) their sinulanty io the situation. 

The Modification of Schemata 

By relaxHig the restiictions o\' ar^unitnts ol a schema, it is often possible to 
apply it to a new situatitm. We give two examples of this later, A scliema must 
specify the pn)per set of conditions to whigh it can apply. When a schema is 
misapplied, the (clevant modification is the imposition of restrictions, so -that 
the schema V0[\ not be misapplied in the future, it is possible to Qombine a 
number of schemata into a single, higher-level schema which caji then be applied 
to a more ct)mplex situation. / 

In Iciirning by analogy, the student basically selects a scliema with^an appro-' 
priate prgani/ation, even if it is for an inappropriate topic area. If. tills scherpa is 
already Well learned and easily appHcable ttAituations for which it is normally 
appropriate, then it .prt)vides a tiseful frame for the understarTding of the new 
topic. By proper instruction, it can be modified to apply to the present 
situation. I-or exumple. we find it useful to introduce computers and computer 
programs by drawing on the student's knowledge of plays and scripts* We explain 
that the script is replaced with the concept for a program and the performers 
with the computer. This use of o\d schemata constitutes a powerful way to. 
intrtnluce new inlormation about a complex and unfamiliar area. 

Examples • • ^ ^ 

Here we ['resent three examples that demons trute difierenl aspects of 'the 
pr(>cess of learning and teaching. All illustrate the ways by which teacher and^ 
student use schemata. First, we show that one use of knowledge schemata is to 
allow for intelligent guesses, even when very little is actually known, about *he 
specific ct)i[ice[U under consideration. This point is illustrated in what we call " 
Ihr Maycnnaisc Pmhlfni. Second, we show how the pritK existence ol* schemata 
relevant to the topic matter that is being studied can be both aiiclp and a 
hindrance to the student. We call this The White Sauce Problem, Finally, we 
discuss how ,t pet son actjuiies and modifies schemata, basing succ(?ssive new 
understanding^ o\ the. topic hcin;^ stud^ed on modjt1cati(m of the old schemata 
for that topic. Wti call this The Jump Problem. The first. two examples are 
presented reasonably briefly, for they act more as enjoyable, liglit examples^ than 
as prof(nnid statements of major theoretical substance. The last example, the 
Jump Problem is presented in more detail, for although the work presented here 
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represejits only the beginning steps in our studies, it does raise issues on'which 
we wish to concentrate our attention in future research. i 

Example: The "Mayonnaise problem. The study of ccvoking provides a useful 
example of the difficulty of learning complex subjects, especially the use of 
previously ^acquired schemata. To a noncook, the co'mbination of ingredients in 
mayonnaise is not at all an obvious one. First, no heat is applied. Second, the 
basic components do not match most people's conceptions of what it should 
take to make a smooth, white, creamy substance we know as mayonnaise. It fs 
for tliis reason that it is interesting to ask naive subjects just wliat they expect ^ 
mayonnaise to be made of. They are forced to use the closest schema that they 
have: one that has some properties in common with mayonnaise. Their responses 
give us some insiglit into how much a person can warp a schema to, a foreign 
situation. We claim this use of schemata through analogy is very widespread. In ^ 
Table 1 we present protocols collected from two naive subjects who were forced 
to specify how to make mayonnaise. 

TABLE 1 
Protocols for Mayonnaise Problem 

Pro.tcicoi of the e\pcri?nenter t DAN) and CN, an H-year-ojd fenuiJe 
OAN: lU»w do you make mayohnmse? 

CN: Hov* you make mayonnaise is you look at a cookbook. 
DAN: OK, hut without looking at a ciH)kbook, can you guess what it is that's inside of 
mayonnaise^ 
CN: Vh. 

F)AN: How you would make it'^ , . 

CN; t'h HuUcr u!i let mc think {5-scc pause ) hmm < lO-scc pause) wliipped crcara 

very very very fine ly whipped so it's smootli. Tliat's probably how you make 
it/just Willi whipped cream, very very very very Hne and smooth. ' 
DAN: Anything else? ^ 

CN: You. might add a httle taste to it. " 
DAN laste of what" 

CN {l()-siH pause) Si^rt of a vanilla taste. 
l)\N Suppose I said tJuit mayonnaise is nude \u\n\ eg»; yolk and oil. Wliat would 
you say? . ' ♦ . . 

CN: I would say it's very very wrong. , 
DAN: Why 

CN You t\nrt lust make mayonnaise oui n\ egg yt>lks and water I mean and oil. 
DAN. Why noC 
CN: Because of taste and snuK>thness and stuH like that. 

Prot()u.>| of ^iie experimenter (DAN) and (JB, an adult maJe psychology pro- 
^ lessor 

DAN How Would y(m make. something like mayonnaise " 
Gil: Mayonnaise.* How lU) y<ni make maytmnaise? You can't make tnayonnaise> it * 
has to be bought m jars. Mayonnaise. Cm. Y,ou mix Whipped cream witli, umm 
some musfard. ^ , 
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Tho iiK'xoiiiiaisc protocols illustrate tiiat previously developed scheinaia can be 
applied to iiew.prublerns. iu)t necessarily in appropriate tashion, of course The 
ih'terniinant-, ul which schemata uet applied are the leatiires which c6nie4Vorn 
wliat IS known: m this case, the ieature^ of (he end result. The problem is that 
tfie relevant [Moperties *>( eiii^ jmi ^,m} their in teradions { that they can forma 
wliito creaniy substance) are not part of any stored sclieina, so tlie'correct 
answer cannot be derived/As the examples illustrate, mayonnaise has properties 
^ which make it look more like certain dairy products than the result of mixing 
the yolks ot e^i^s with oil.- 

Tho point of this exercise is simple (perhaps too simple for the space it has 
occupied). We believe tlia^ tlus use of old schemata thru analogy is all pervasive 
and piiwerfu.1. Aljhough the sauces derived by our two subjects are not at all 
mavounaise. they are intelligent creations, and they, are not bad sauces for some 
put[H)se>; Normally, this^cieative use of an old schema for a novel purpose is an 
t'^serilial use ot the creauve process of discovery. 

I ater we return to tlrts issue. V/e believe that the mayonnaise problem is an 
exafupje nt "lum t tonal re^itoniug''. Here is what we believe is involved: 

I . No kn.ow ledge of the'conifionents of mayonnaise existed.. 
J. It is known that niayonrmise is.sniooth, creamy, off-white in color. Its taste 

IS known (a^id it is somewh'at ^??ftlicj. 
3.. CJeneral SLiienia. 

Blends- ol toods blend their properties. 

lexture- viir cream or whipped creani \ ields a color that is too white 

and a tasle tbat is rait right. 
Correction add veRoW'S}»icy acidic mustard. 

So we have 

Selection of scheuitibv analogy, 
Motiification tow ariis goal. 

JIus is roasomng hv analogy. \u lunUional leasoning wc claim there must be one 
more step, tlie schema has vanable'^ in it, and any ci)ncepts that ftiUlll appro- 
priate range restrictions on those vu[iables may he used in the solution of a- 
piohleni. ■ 

s . i 

t ^r}/rjf)lL^ Thf} whitf^ 'Uiuca problem. One impmtant component of the 

process ot learning, and teaching is tfjat of communication. The teacher has the 

I . "jtmIv'' Hi.iv >rtiMi-.v. th- puf-. ',.*lk> in a nnxiim iitnvl wiUi one teuspcHMi of 

vinriM: hi I-TTiiTi '.\ s^- 1-.' v)ini!'\ nuv l>r nUl\\ \i\t\ u\ns{.\H\^ s.ilt, white popper). Then, 
uhjir hfiMrn- \r::.vr.-,ul'v wnh i wu.^ \\h\\\ m1 w ,uiilra, <lr<'p In ili>)(>. until tlii- mixturt* is 
thuk .uui vrr irnv i l^^ou^ ' ^ cup v. ill M-^rc ^-il is then iddt'd m \ slnw sto.uiv stream tall 
the h^vrin- vi-.>r WIkmi I • I ' , * ;i;>', mi h.tve Iven added, mix m .\ seeond 

t..'.isp' i-t viri>.' T K> ;;i^>n rnav • . 

ErJc liil 
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task lit- coii'V^'vin^ a j)drticiilar knowledge structure to tlio student. The leuruer 
has llie t;isk;*>t doduciuii just what structure is intended by tlie teacher, as well as 
•the addifinnal,,t.isk ut adduij? t[ie new mt'orniation to liis previous knowledge ?n 
such a way thai. it can be lelerred to and used at a hiter time. Many ol* the 
problems ot' leannng and teachuig can be understood as piuhienis in tiiis 
conunuliicatiDn process. L„earmnj?,. however, is unhke most sunple communica- 
tions in that the structures to he acquired can be complex, and it is not always 
clear )usl how ihey are to tit together. Moreover, .the differences in the knowl- 
edge shared aiTn)nii the participants ui a learning situation are often considerably 
greater than in snnple discourse. 

In many ways, this aspect of the fearnmg process is actually a problem. First, 
there is the prt)blem of Kleiitifymg the appropriate referent of determining just 
what topn IS under ct>nsideration. Second, there is the probleni of st) specifying 
the mloim.ition licniii acquired and incorporating it within the memory struc- 
ture that It can bo recoveied when later it is needed. 

Social conventions i:ovein the form of the interactions between a teacher and a 
student, with cori im \v«'ll-formeti conventions about tli-e nature of the inter- 
actions and <[Ueslions that normally take place.- A private tu tibial allows for 
more interaLtitui than does a seminar: in turn, lectures allow few i)pportunities 
for the commumcativt' asjiect of the learning process to take place. 

One .ispect of this ct)mmunicatory process is that the same teacher inay use 
quite tlifterent procedures io teach the same material to two different students. 
In our studies tlie tutorial dialogues between beginning students and tutors 
auul'advanceii students and tuttns. the difference is expository style is clear: the 
tutor lends to lecture (he beginner: with an advanced student, things are more 
like a relaxed conveisalU)nal interchange- of information. Books rcHect this 
ditlL'ience. lot the stvle of the b(jok depends upon the level of the student which 
It IS addressing. One example readilv available conies from a ct)inparison of the 
recipes in an elementary cookb:K)k with the recipes of im advai\ced cookbook. 
Thus, one recipe foi mavonnaisc in a i^iok intended for advancetl coi)ks takes 
exact l\ ax sentences (fw words) aiul a list ol ingredient^; I'.sbentially the very 
same reci[K^ f«»r a l^egmnmg c(n>k is around 1.^ times longer: three pages of text 
or about words and a list of ingredients.* 

' \ , .k ()| ' .n 1 iTi ».'r iv fj' >r) , '! i < 'irs^;, .iltlp Mi/li lit m Mtu* sfii v.- fho nsi* ot hraTU Iuiil*. 

rtM<^l!iM,» fTiuhir'.' ^-xrs -r sitnp}o ^ ^ntputi-r .jssistftl instrucf lori'^ si-qiicnccs do rectncr some 
jsp<\tN "t rhc .v«.'niiT\uni..aM 'tt I he r-.'ti'ru work h\ C.irbonell (PJ70, I^Tl) ami ( .>nins, 
W.iriif'^k. An 1!", iU'.\ WiUvi I i') 'S, arul [Uouji. Biut<'ih And /livlx'l ( 1973) .ulds voftiimii^ica- 
ti«ni 1 »!f?rnu-r udvit ir. .rr .i, ♦c^n Iv, pf I'Mthn,^ f (u* v mrjputtT system witii a senlaiUic ru'lw ork 
mI krh.'A lv:4*^+J?''iif thv- •'>iMi rTT,'»'rr ami jilc'.Mii;' U irU- rat t im a tutorial lasluou with tlie 
stUilent 

*\Uc adv,jni.c'.I ;.*\aTnpje ^'»Tiii.s tr^ni "\I.i^fcr'^uea"N f'i i rciuli ( utsiiu" l'\ Aiminatetiui 
.trni !he !!rr d i.. f i*. -vainple rr ^ri ••\t.r.rerin;i^ the Ar t . 'H ri't>c}i C \ n*ikini:** In Child. 
Mcrrh^'ll'.\ ii)d H.- k « r^M » 
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One technique we have used to e\pU)re the processes of learning and teaehing 
IS that of t\itt)rial instructum. FH)r these tuttirial studies we picked the topic of 
I'lench cooking to be exact, the subset techniques invt)lved in the making of 
the family of white sauces. This topic is well suited for our purposes: complex 
ent)Ugh that it constitutes a challenge i\n tlk learner; sufficit^ntly self contained 
that one can hope to learn a considerable amount within a reastmable amtmnt of 
time. Moreover, it is easy to fuul well nu) tivated students and teachers. (We 
concentrated the sessions on the coverage provided by Child, Bertliolle, & Beek, 
1%1. pp. 54-^)3.) 

Suppose you set out to teach someone the family oi' I-rencli white sauces. How 
sht)uld you present it'.^ How does one get across the entire network of inter- 
related concepts? 

When an advanced cook tutt)rs a beginner, there is a tendency to lecture at 
first, desciibing the overall family of sauees. Then, when the overview descrip- 
tion has been completed, the beginner's lack of understanding often surfaces, 
causing a tumbling, exploratory interaction in which each tries to understand 
what the either is thinking. 

Table 2 shows a small excerpt from such a tutorial. .The advanced tutor (T) has 
tlnished a twenty minute lecture on the white sauces. He concludes by saying; 
*'and I think that's all there is to say." The student (S) iias been following, 
making appropriate comments along the way. But now, unexpectedly, the 
student asks a ijuestimi which indicates that she does not understand the overall 
pattern of sauces. The tutor is disturbed, and there follows a period in which tlie 
tutor tries to straighten tmt the concepts. This is a portion of that conversation. 
It starts with the student attempting to summarize her understanding of the 
sauces.^ 

The tutorial shown in the table illustrates a problem with reference, if the 
student (Inds a partially correct reierent, errors may go undetected. In this case, 
It seems that the student t)riginally had a concept for white sauce (the standard 
American white sauce): heat together butter and Hour and then add milk. This 
lits easily with the new use of the term '*white sauce.'' But French white sauces 
can also be made from fish or chicken stocks without milk or cream. This new 
procedure does not fit the student's existing memory structures, and a good deal 
of confusion ensued until the tutor was able to straigliten it out. It was only 
when the discrepancy between her previous conception of white sauce and the 
I-*rench conception was explicitly mentioned that she began to make sense out of 
her lesson. The interesting thing about this tutorial session was that for the tlrst 
20 minutes, neither tutor nor student realized that there were any problems. It 
came as somewhat of a shock to both participants to realize that there were vast 
contusions, and the entire session lasted fiir 45 miiuites beyond the point wht^re 

' \\c tlunk J, I u^r^u^ S. Sdi.int\ .ind I . Wu^litniaii lor ^e^fiI)l• as tutors and tulees. 
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TABLE 2 

Beginning Student and Advanced Cook Tutorial'^ 



S: \Vc start out uuh iwo liittVrcni while 
saiKcs, V'*mtc aiul licihanuH and 
Hcchanicl is with niilk dii! \ oij sav* 

T: Rh:\n. 

S: Velouic is uilh c^n^ yolk and iTcain 

so \i\ richor. 
T: .*l*h no. Ik^chaiiicl is with milk, 

vvloiito- is Willi shHk. 'Ihai\ the basu 
o dilterciKc 

iS; Oh thaVs iij'lil. Wi' niaiU* iho veUiiiU' 

uUo Parisieiinc, 
Ti , J'ither (lu^ Bci.h.inu'1 ... 
S: 'OK. 
. *! : or the veloutc can he a Pansicniic. 
S: What Aiucncan cooks mean when 

they sav a white sauce is- Hecharnei. 

They mean a rotivwith 
'T:. Milk. 
S: Milk.^ 

.( I he prohleni here is that the student 
ci)nt;\ised her knowledue i>t Aiiieritiah 
white sauce with the related hnt dh- 
terent concept o| the I rencli \ il\ 
ol white sauces. The tutor a^ain lo- 
viewed'the concepts involved in the 
. sources. The student tried to review;;) 

S: (U>iu' pause) OK. (lon^ pause) It you 



take", a sauce made with stoLl< in- 
stead ot milk and cream, and add c\ug 
yolks I - is that ever done? 

I " ThalN a Parisieiine. 

S: The Parisienne doesn't have to start . 
/ with the veloute. 

f: ' ' The Veloute is 

S: Has cream or milk. 

T; No -no the veloute is the roux and 
tiie stock. 

S: I keep 1 keep mixing that up. The 
veloute is stock - and then cam - 

T: The Bechamel is the , milk- base, 
(pause) And from both of those you 
can ^et to Parisienne by adding egg 
yolks and cieam. 

S: ' OK. 



(At this point the tutor reviewed the 
concepts. The student summarized 
the problem;) 

S: Tni eonfus'ed because Bechamel i.s 
what 1 originally learned as a white 
sauce and a white sauce Ms a large 
class w ith all these different kinds of 
sauces. 

T: Thaf^j right. 



^Roux:. A mixture of flour and butter tliat serves as a thickening agent. Lightly cooked 
(for white sauces), browned t'o make brown roux. 
Stock: Clear or brown luiuuL usually made from chicken or fish (white stocks) dr meat 

brown stocks). 
Bechamel: A basic while .sauce made with roux and milk. 
Veloute: A basic white sauce made with roux and white stopk. 
Enrichment: The addition of butter, cream, or egg yolks. 
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the tutor had into uled to end the session hv saying, "and I think tliat's all there 
is to say/* 

This section shows one aspect of the connminication between teacher and 
student: the difl'erence between the student's prior conception of the topic and 
the actual one to be learned. This prit)r conception guides the student into some 
erroneous assuniptit)ns, hindering tlio final acquisition of the concepts. 

Example: The jump problem. This last example is the most serious of the 
thiee we wish to describe. What we want to discuss is how a student accjuires a 
schema for a ct)ncept, disct)vers places where it does not operate in an appi^o- 
pnate fashion, and then nu)tlifies the schema. We feel that the most important 
cognitive structures that we should study are those that allow the discovery of 
the inappropriate aspects and change them. We will say more about this later. 
Alas, we will nt)t be able to say it well or precisely. 

In our studies, we took students at the University of California, San Diego who 
had no previt)us experience with computers and put tliem in front of a visual 
(television) display and a typewriter keyboard. They v/ere given a series of 
examples in progrannning in the language FLOW, starting off with some basic 
principles. At times, the students were ysked to type a particular program into 
the computer and then to predict the result t)f that program. After the student 
had predicted the result t)f the sample program, he. could have the computer 
perform the program and observe the result displayed on the screen in front of 
hini. At times, we asked the students to write new programs that would 
accomplish some goal. 

The computerv. language is very simple. F'or the aspects illustrated in this 
chapter, only two principles neetl io he understood: 

All programs consist of an ordered set of a)nnnands (in the examples here, 

most programs are only 2 or 3 lines long). 
Lach line of the program is numbered lor easy reference. 

In this section we illustrate st)me t)f the prt)blems in developing an accurate 
schema for one ol the commands of the language l-XOW. We follow the course 
of one student who is learning to use the command *Mump to . . , She has just 
previously learned tt) use the ct)nnnand "Print"/ in several different programs, 
but no prograrn was longer than two lines and most contained only a single use 
of the 'Trmt'' connnand. In this section, we are primarily concerned with the 
examination of the intera^^t'on between the student's understanding of the 
concepts as represented by the schemata that she has devek)ped and the program 
'^that she is creating. We trare the dovelopmen't of the schema for "Jump to'' 
through successive stages of experience with different })fograms.that result from 
the schema. •» . 

We start watching the student" at the point where she has been asked >to type 
the folU)wing program. Program I, onto the display terminal. 

.. . \ 4? 

Jo 

0 

ERJC 19, 
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Program 1: 010 Print "Rocholle" 
020 Jump to 010 

Experimenter: This program will make the computer repeat the printing of 
tjie word "Roehelle." What do you think the output .will 
look like? 

Student: The computer will print the word **RocheIle" twice. 

The answer is consistent with the ordinary sense of the word "repeat." It is also 
consistent with the student's \moT experience, for in previous programs where 
there were no Jump statements and where at most there were two print 
statements, any program that repeated the same printout printed the same word 
twice. If we could characterise this student's schema for the purpose of the 
"Jump to'' instruction, it probably would look something like this: 

Schema 1: If the instruction is **Jump to then the computer does 
instruction number //. 

Now the student was instructed to run Program 1. When she did so, the output 
that api.)eared looked like this: 

RochelleRochelleRochelleRochelleRochclleRochelleRochellePvOchelleRo . . . 

Student: I guess it keeps repeating until someone tells it lo stop. 

By her comment, the student has clearly learned something more about the 
**Jump'' statement. To test what she had learned, we aksed her to enter a new ^ 
program into the computer and to predict its outcome. 

Program 2: 010 Print "Hi" ' 

020 Print ^^Rochelle" i 
030 Jump to 010 ; 

^ Hxperimenter: What do you think this program iWill do? 

Student: Its first instruction is to print ''Hi" so it will do *'Hi," then 
it will (pause) there's no Ispace, so it will just go 



'*HiRochclIe" for the second 



instruction. And then it will 



go back to the first instruction which was Print **Hi,'' so it 
will jusjl write *'Hi" until we tell it to slop. 

We see from this example that the student has modified Schema 1 into a new 
form, something.hke this: . 

Sciiema 2: Do each instruction in order unless the instruction is a JUMP- 
TO. If the instruction is JUMP-TO then continue doing 
instruction n until told to stop. 
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Note that this schema, even though incorrect, is perfectly consistent with 
everything the student has seen up to this point. She has derived her notion of 
sequential order of execution from earlier programs and has used it here to 
predict the first two elements of the output. From Program 1 she has seen that 
tlic Jump-to in that program caused the instruction to be repeated. Hence, she 
developed Schema 2. 

The test of the student's schema came when she was asked to run Program 2. 
Here is what happened: 

IliRochclleHiRochelleHiRochelleHiRochelleliiRochelleHiRochcIle . . . 

Once again the result was not what was expected. Once again the schema for 
"Jump" had to be modified. 

Student: When you say jump to the first instruction, it will go to that and 
then I guess it goes to the second one and if there isn't a second 
one it will just keep repeating the first one. Otherwise it will 
repeat both. 

This is a rather complicated and highly conditionalized notion, but it is perfectly 
consistent with all examples she has seen. When she was asked to describe how 
the computer actually performed Program 2, she provided a correct line byline 
description. Her schema now might be characterized like this: 

Schema 3: Do each instruction in order unless the instruction is "Jump to.'' 
If the instruction is "Jump-to /i," the'n begin doing instruc- 
tions at number 

If there are no more instructions, stop. 

Again, we tested her knowledge by asking her to type a specified program and to 
predict the result:. 

Program 3: 010 Jump-to 030 
020 Print "Hi" 
030 Print "Rochelle" 

Student: The computer will go to the third instruction and print 
"Roehelle" then to the second and print "Hi" and then to the 
third again and print "Rochelle." 

The actual result is this: 

Rochelle 

Only the one word is printed, and then the program halts. Why did the student 
predict what she did, when according to Schema 3, she should have been able to 
predict the result properly? Evidently she has other schemata about the opera- 
tion of the computer. Many students seem to believe that every statement must 
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be executed at least once, and this schema could apply here. If so, tliis causes a 
conflict with Schema 3, wliich miglit possibly be resolved by a reversion to one 
of the earlier schemata for "Jump." Whatever the reason, it was a simple matter 
for the student to modify her schema for "Jump." When she saw that the output 
was the single word "Rochelle," she was readily able to determine why: 

Student: The first instruction tells it to go on to the tliir4 and then there is 
no instruction to tell it what to do so it stops. 

Now, finally, she seems to have a complete and correct schema for the "Jump" 
instruction, When given two more tests, she predicted the results correctly: 

Program 4: 010 Print "Hi" 

020 Print "Rochelle" 
030 Jump-to 020 

The predicted and correct result is: 

HiRochelleRochelleRochelleRochelleRochelleRochelleRochelleRochelle ... 

This shows that the student doesn't believe that each repetition needs to be the 
same. 

Programs.: 010 Print "Hi" 

020 Jump-to 010 
030 Print "Rochelle" 

The predicted and correct result is 

HiHiHLHiHiHiHiHiHiHiHiHiHiHiHiHiHiHiHiHiHiHiHiHiHiHiHiHiHi . . . 

This program shows that she understands that not every line need be followed. 

These examples point out the ways in which a student formulates hypotheses 
about the concepts which are being tauglit, applies those hypotheses, and 
modifies them when necessary. Learning appears to be organized around small, 
simple schemata that can be applied to situations wherever deemed appropriate. 
Part of the task we must face is to determine how a person comes to acquire, 
apply, and modify these schemata. 

Learning by Modification of Existing Schemata 

To transform the examples of the use of schemata that we have presented here ^ 
into a viable," useful theory of learning, we need to specify with more precision 
just what it is that takes place when a schema is selected, used, and then 
modified. We arc not ready to report much information here, but we can tell 
you of some related work that seems relevant. 

First, consider what kinds of structure a person needs in order to be able to 
modify his schemata. The student needs to be able to compare the results 
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predicted by a given scliema wUh the results tliat actually occur. Then he needs 
to determine the points of niisnmtch, ami then correct that mismatch. Thus, he 
needs a process witli some access to the procedures which it is examining and 
modifying. This is no simple feat. 

Tiie problem of learning through errors is, of course, a well known one. 
Seymour Pnpert and his educational group at tlie Artificial Intelligence Labora- 
tories at MIT- have j^nade a big issue of this form of learning. Debugging, is what 
Papert calls it-the process of eliminating the errors or bugs in one's own 
knowledge. The skills of debugging are clearly important ones. Papert believes it 
is perhaps even more important to teach a child how to debug his own 
knowledge than to te:ich him the knowledge itself. The in\pHcation is that if a 
cl'iild knows how to learn, then he can get the knowledge by himself. We find 
that this pliilosopJiy strikes a sympatiietic chord: Wiiy do wq, not attempt to 
teach some basic cognitive skills such as how to organi/.e one's knowledge, liow 
to learn, how to solve problems* how to correct errors in understanding: these 
strike us as basic components wiiich ougJit to be taught along >with the content 
matter. 

There lias been some work in the Massachusetts Institute of Technology 
Artificial Intelligence Laboratories On the mechanisms necessary for transform- 
ing schemata that were in error into better ones. Oiie of the best known 
examples of this work was performed by Winston (1973). Winston showed his 
system figures of block structures. The system would develop network represen- 
tations for the structures (very similar in form to the structural networks of the 
LNR representation). Winston's system corrects schemata by comparing the 
representations for the various objects and noting the differences. The network 
gets modified according to the nature of these differences. In fact, Winston 
shows how the most important aspect of the training sequence is the nearmiss: 
the appropriate form of deviation from the schema. . 

Now without cxceptit)n, everyone we have ever talked to who is either in the 
field of educati()n or in learnitig gets very angry when we tell them of Winston's 
work. 'That^s nt)thing very remarkable," they sputter, *'why if you go look at 
any elementnry education text, in ihc work of - ,.. " etc. We agree, but disagree. 
Winston's work is not important for the coitcept of the near miss. What is 
important is that he has managed to develop a.l'orma! procedure for representing 
certain kinds i)f krunvledge and then for changing that representation wheji it is 
found not to be appropriate. U is one of the most sophisticated examples of a 
learning program of which we are aware. 

More recently at The Massachusetts Institute of Technology, Sussman (1972) 
and Gi)ldslein (1973) have taken another step closer to the development of 
learning procedures. They have managed to develop systems that can correct 
pr()grams, find the errcus, and modify them appropriately. 

We are still not at the point where psychological models can be developed 
around these formalizations of schemata, and the suggested mechanisms for 
modification, but we believe that we are elo'se. 
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SOME GENERAL COMMENTS 

Lcaiiiing involves the acquisition of new cognitive structures built lipon oicf, 
previously acquired structures. Sucii a statement, by' itself, says little that has 
not been saia many times before. What we believe might be new is some 
understanding of the underlying representation of these structures. - 

The overall structure for a concept matter is not yet known. In this chapter we 
have discussed some extremely simple knowledge frameworks: for verbs, for 
simple- recipes, and at the level of verbal description, l'5r a programming lan- 
guage. At this point we wish to speculate upon two or three issues relevant to 
the acquisition and use of these schemata. First, some comments upon theory. 
Second, some comments on what should (or could) be taught. Third, some brief 
comments on the problem of communicating the relevent structures to the 
student. 

On theory What has been shown here is very incomplete.. It certmnly is a far 
'distance away from what we claimed to be interested in: tlie learning of comples 
topics. We need to specify how we interrelate all the information. We still need a 
lot of work on this problem. We think the important principle is that the 
. material is organized around schemata. There does not seem to be a homoge- 
neous network structure. Rather there seems to be well structured means for 
organizing the information, and for functional procedural definitions. Moreover, 
the schemata provide means for applying the structures to new and to unusual 
situations. 

On what might one teach Two general principles seem applicable: 

Introduce the gcficral framework for the material that is to be learned. 
Build upon the general knowledge that previously existed. 

One different form of knowledge that we believe to be important is to teach 
Teaming skills: 

The student should know how to evaluate afjd modify his schemata. 

in the examples shown above, it has been important that existing schemata 
could be modified. This is true whenever a .schema is inappropriate either 
because one simply doesn't know enough or because one is reasoning b.y 
analogy. 

In general, one has to know how to understand the. nature of this reasoning 
process to be effective at doing it. We ihave been impressed with Papert's 
teaching of '^debugging skills"- we believe he is correct when he places heavy 
emphasis on this. 

Functional reasoning Collins, Warnock, Aiello, and Mjller (1975) have 
demonstrated some nice examples of what they called "furlct(ional reasoning,'' 
reason in which knowledge is deduced from general p/inciplesj. The most inter- 
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csting cases occur when the person doing the reasoning is not aware that he 
knows- any relevant general principles. What in fact happens, we believe, is two 
things, Firs:t there is something akin to our mavQnnaise example: reasoning by 
analogy. Second, comes the examination of several examples and a generaliza- 
tion. A general principle can be considered to be one in which the :Schema has 
many of its constant terms replaced with variables (the variables will have 
constraints'placed upon the set of concepts which may be used to fill them). 

The process by which one takes specific knowledge abtnit a particular instance 
of a concept or ot' an experience and generalizes it to apply to a larger class of 
experiences is one that needs a gt)od deal of study. One suspects that this 
generalization process is at the heart o\^ much of our everyday operations in 
which new situations must be dealt with by the experience gained from old ones. 
Lt^arning by analogy, learning by mt)dification of existing schemata, the use and 
interpretation of metaphor, and functional reasoning would all appear to be 
related examples of tfiis generalizatitni of knowledge. As we gain in our under- 
standing of the structures of human menniry and in the ways by which the 
knowledge structures are acquired, mtidified, and jised, we will come to enrich 
our understandmg of learning, of teaching, and of the human use of knowledge. 
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INTRODUCTION 

The task of developing a psychology of instruction is formidable because we 
must first understand the nature of knowledge, how it is acquired, under wh^t 
conditions it might be taught, and the signs by which its attainment might be 
celebrated. Of course, our task would be foredoomed if every area of knowledge 
were so distinctive in its requirements on the human mind that completely 
different cognitive processes were invoked in t^ach case. If so, then the most help 
educators might realistically expect from, psychologists would be a pluralism of 
principles consisting of independent sets of heuristic tricks^ especially tailored 
for each area of pedagogical focus. 

- Clearly, the working hypothesis which best serves both psychology and educa- 
tion assumes that knowledge-gathering processes of mind are essentially the same 
across all disciplines, that any differences will be in detail rather than principle. 
Let us then begin by posing the central problem for a cognitive theory of 
vinstruction in \\ way that presupposes this working hypothesis: what Js the 
nature of the gmeral cognitive capacity that underlies all knowledge acquisition? 
It is to this questibn that this chapter is addressed. 
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THE ABSTRACT NATURE OF CONCEPTS 

0 

A basic clrdracterislic of Iniman intelligence is the ability to formulate abstract 
conceptual knowledge ghoul objects and events. Abstract conceptual knowledge 
is exemplified when we can deal appropriately with novel instances of a concept, 
that iSyVvhen our knowledge goes beyond just those instances experienced. 

There is abundant evidence that our knowledge of language must be abstract 
given the novelty ^hal must be dealt with. Indeed, the fole of novel events in 
language has long been recognized by linguists. Sentences are almost always 
novel events. To verify this fact you need only pick at random a sentence in a 
book and then continue through the book until the sentence is repeated. Unless 
you have picked a cliche or a thematic sentence, It is unlikely that the sentence 
will reoccur. We readily admit that most sentences are novel, but what about the 
elements from which sentences are constructed? These elements must be the 
same in -order for us to understand sentences. Further examination, however, 
shows tliat words too are typically novel events. The apparcp* physical sai^ieness 
of words. is an illusion supported by the use of printing presses. If we consider 
handwriting, we find a great deal of variation in the construction oheltersand 
words. The novelty of words becomes even more clear when we think of the 
same word spoken by different speakers, male and female, child and adult, or by 
the same speaker when he is shouting or whispering. Words, like sentences, are 
typically novel events. To say that words are novel events may be incorrect in 
some instances. We have heard our friends use the same words many times, our 
own names being a case in point. The importance of the argument for novelty is 
tt) illustrate that this repetition is not necessary for our understanding of wor^ls; 
thus our ability to recognize words is not a function of having experienced that 
p-dTiicuhr physical event befilre. 

Greenburg and Jenkins (1^)64) demonstrate an even more striking example of 
the capacity to deal with novel instances 'of a class. They, found that English' 
speakers could deal appropriately with novel scquenccs'of Hnglish phonemes. 
Sequences tif Phonemes in Hnglish iire subject to powerful constraints described 
by rule structures for syllable and word formation, if* we randomly sample , 
strings of Hnglish phonemes we will produce three types of strings: strings which 
are actual Hnglish syllables or words: strings which violate the rules for English 
syllables and word construction and therefore are not English syllables or words; 
and finally, strings which are in accord with Hnglish rule structure, but are not 
found in Hnglish. Given only consonant-voweKconsonant (CVC) strings we all 
rccogni/e cat as an actual Hnglish word and cah as clearly not an English word. 
However, what about the strings clih dud lutt? Both of these CVCs are in accord 
with Hnglish rules of syllable construction. /)//; is in fact an actual English word. 
Consequently, Greenburg and Jenkins constructed a measure of distance from 
English, based upon the rikies of English syllable construction, which accurately 
predicted subjects' judgments of novel strings of phonemes. The subfects' judg- 
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ments about novel strings of phonemes were consistent and predictable on the 

• basis of linguistic rules for syllabic construction in English. 

This research clearly demonstrates that the knowledge, on the basis of which 
English speakers recognize and construct English syllables and words, is abstract 
in the sense that it is not knowledge of particular physical events, but rather 
knowledge about systems of abstract relationships. One's ability to recognize 
sequences of phoner.nes not experienced before a^ acceptable or unacceptable 
English strings demonstrates khowledge of rules ofsequencing of phonemes, that 
is,, abstract conceptual knowledge wliich allows us to recognize and produce 
novel events. 

. But phonemes too are abstract classes ^f events which cannot be specified in 

• terms of common physical elements. Research in the perception of speech has 
shown that the same phonemes are specified by different physical events- in 
different contexts and that the same physical event can specify different pho- 
nemes in different contexts (Farit, 1964; L^berman, Cooper, Shankwciler, & 
Studdert-Kenncdy, 1967). So, ^with phonemes too, the basis of recognition is 
knowledge of a code or system of relationsliips, not knowledge ,pf particular 
physical elements. As we have seen, breaking language events into smaller and 
smaller elements does not result in a level .of analysis based upon particular 
physical elements. Rather, at each level we find still another system of abstract 
relations which is necessary to specify the nature or meaning of particular 
physical events. 

Similarly, we arc able to recognize a melody played on a piano even though 
previously we have only experienced instances of t^iat. melody played on other 
instruments, or by an orchestra, or even hummed. To do so, therefore, we mus^ 
have an abstract concept of the melody that specifies the isomorphism existing 
among the various instances. Often we are able to recognize that a painting is 
executed in the style of impressionism or by a particular artist, say Cezanne, 
even though we have never seen that' particular work before. To do so we must 
have an'' abstract concept that specifies the style of the school or artist such that 
the instances, novel ones included, are seen as similar. Thus, there seems to be 
ample reason to conclude that concepts are not necessarily ^^based upon knowl- 
edge of particular physical events, nor upon physical units, elenients, or features, 
since instances of many concepts are only abstractly related. 



GENERATIVE CONCEPTS 

Due tti their generality, nbstract concepts apply to a potentially infinite equiva- 
lehre class of instances. However, this fact poses a serious prablcm for a 
cognitive theory bent upon explaining how they arcoacquired. Since one's 
experience is with but a s.ample of the entire set of instances' to which such 
concepts refer, several puzzling questions arise: First, how can experience with a 
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subset of ohjects or cveius lead [o knowledge of the whole sot to which it 
biioaes' There is a ph^bleiu i>f explaining how sunic part of a structure can be 
^Hiual to the whole structure. Indeed, the claim that sn7tic can, under certain, 
circumstances^ be equivalent to all seems to involve a logical contradiction. That 
It does not, fortunately for cognitive theory, can be amply illustrated in many 
different areas of conceptual knowledge. In a moment, we will illustrate this fact 
from examples drawn from three distinct fields mathenuUics, linguistics, and 
perceptual psychology. 

A second crucial questiv)n that must be answered, given a precise answer to the 
first, cimcerns the nature ot the* subset that can provide the knowledge necessary 
to deal with the entire set. Will lUst any suhset of instances do, or nuist the 
subset be a certain si/e or quality*' In other wtirds, how do instances of a 
concept qualify as exemplary cases of the concept? A precise answer to this last 
ilU'.^sJion ha*, quite obvious implicativins for the selection of effective instruc- 
tional material lor teaching concepts. 

Genorativt' ( onrfptsin mathematics. In rnatlieniatics the concept of ^in intl- 
p.ite set proviilcs a^structure for which it is true that a proper subset.is equal to* 
the total set. Cantor prt)posed this detinition of the infinite when he discovered 
that a subset of all natural numbers, such as the even integer, can be placed into 
a ono-to-one relationship with the t{)tar.set of integers. But a more relevant case 
lot our purposes is the probTem of providing a precise description for an infinite ^ 
class ol' objects. By a precise description is meant a nnite-specification of every 
instance t)t the intuiile class. * ' , 

\ mtunentN retlectitin sutTices to conclude that i^O'CAWcd nominal concepts are 
quire inadequate tor this purpose since it is impobsible to osten.sively define an 
mtniitc cfass, say b\ pointing to each element. Hence the label 'Infinity" could 
ri'^t be coi;isistcntly applied sinve finite enumeration will not discrimate between 
classes just a little larger than the ostensive count :\n<) ones infinitely larger. 

I '»r sinulai reasons so-called attributive concepts of infinite classes are not 
po ssible since the attempt io abstract common features fnun all members of 
>ucli classes fails, if \\o{ eve;y member of an infinite class is .surveyed by a 
process nl finite abstraction, then a poJentiallv infinite number of cases may 
oxist which tail {o exibit the attribute common to the finite subset actually 
t^xpenencctl. I'hus. (lie learning o\' concepts that refer to classes with a poten- 
iLilK HitiDito numbei of members such as trees, people, red stars, cannot be 
ad.H|uateK explained by a cognifive process involving finite abstraction. The 
pit'cess of abstraction postulated to explain the acciuisition of abstract concepts 
nlu^t work m some other wav. As a mill fi)r abstract" knowledge^ it must take a 
tiln?c set t)l exemplars as grist lor pLoducing concepts of infinite extension. 

Ibis piof)}eni has perplexed pliik^sophers for many centuries, leading some 
ctnpiiicists and nominalists to propos<,^ that in fact no concept of an infinite class 
IS really pt>ssible. Tiieir argument was bn'scil upmi the belief that since finite 
abst^'acfitm is the means by which all' concepts are, formed, then the concept of 
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the infinite must be a negative concept referring only to our ignorance regarding 
the exact size of a very large class which iiad been indeterminately surveyed by 
the senses. This belief constitutes a refusal to recognize the creative capacity of 
human intellignece and led the empiricists to a theory of knowledge founded 
upon associative principles- principles which define knowledge as nothing more 
than the association of memoranda of past sense impressions— what Dewey 
(1939) rightfully called "dead" ideas because they cannot grow. 

Infinite structures can only be represented by finite means if the finite means 
are creative, in the sense that a schema exists by which the totality of the 
structure can be specified by some appropriate finite part of the structure. Such 
a schema by which the whole can be generalized from an appropriate part can be 
called 'a generative principle, while the appropriate part can be called a generat- 
ing substructure or just generator for short. That a structural totality can be 
specified by a generator plus a set of generative principles can usually be verified 
by the principle of mathematical induction. 

Consider the problem of how one comes to know the concept of natural 
numbers. TWo stages seem to be involved: one must first learn the set of 

numerals 0, 1,2 9 as well as a system of syntactic rules by which they may 

be concatenated to form successively ordered pairs (e.g., 10, 1 1, ... , 99), triples 
(e.g., 100, 101, . 999), etc. The number of numerical strings is, of course, 
potentially infinite. Hence the numeral set 0, 1, 2, . . . , 9 constitutes the 
generator which potentially yields all possible well-ordered numerical, strings 
when the appropriate generative rules of the grammar are applied. 

The second stage in acquiring the concept of natural numbers cnt^l\s inter alia, 
not only knowledge of the grammar for numerical labels, but knowledge of the 
closure of arithmetic operations by which (a) any number can be shown to be a 
logic^il product of an arithmetic operation applied to a pair of numbers e.g., 1 + 

0 = 1, 1 + 1 = 2, 1 + 2 = '3 and (/;) any logical product of numbers always 

yields numbers. 

Indeed, it does not take children long to realize that any combination or 
pprnuitation of the members of the generator set (0, 1, 2, ... ,9) yields a valid 
number. For example, is 9701 an instance of the concept of natural number? Of 
course, you will recognize it as a valid instance. But how do you know? Have 
you ever seen this number bfefore? Does it matter? Unless it is part of an old 
phone number, address, or some serial number that you have frequently dealt 
' with, then yDu probably hav.e no idea whether it is a familiar or novel instance of 
the concept of natural number. Nevertheless, one knows immediately tKat it is 
an instance, presumably because one's knowledge of strings of numerals is as 
abstract as that for Knglish sentences. 

Generative linguistic Icnowledge, A similar line of ar^umV^nt can be developed 
with respect to the best way to characterize a speaker's knowledge of his native 
language. The problem is: ''how do we acquire, the linguistic competence to 
compreiiend sentences that have never before been experienced?" For instance, 





il is unlikely that \ ou have ever experioiieeil the rt)lln\ving .ieiiteiiee: the impish 
numkcy clinibal uptm the erys ta I ehmidelier. i^iiii^erly peeled the ere pes from the 
eeilini:, and threw them at the furious i hef. riiis fael, however, in no way 
ihnnnishes vour abihlv to recivizni/e il as a graninialieal, if novel, sentence. 

Whatever tlie [ueeise details, it seems clear that the child acquires genenitiVe 
knowleilge ol his laniiuavie fnuu limited experience witli a part of the whole 
corpus that is potentialiv available. I-urlherniore, on the basis of this lirm'ted 
cxporuMKW he is able to extrapolate knv)wledize about sentences never before 
experieticed by him, as wdll as knowledjie about those never before experienced 
by any^fcuie. 

PresuniabK , the chikPs immediate linguistic environment ct)nsisting of his or 
her tanuiy and local asp«'cts of his culture, provides liini with a generatiu set of 
exemplarv structures from which he educes the generative principles by which 
all <alici sonleikvv are known, ("honisky {M)05) has argued that a transforma- 
(ional grammar piovides the operations del'ining the mapping of the generator 
set of clear case utterances onto the corpus of all utterances', otlier theorists 
disagiee. Ilnwi-ver, un one vlisputes the fact that the aeiiuisitioii of language 
.reiiuires cognitive schemata that are truly geneuitive in nature. 

It IS also wurtli mUirig that during aciiuisition S[)ecific menu)ry for sentences 
experienced seems to play. no necessary role in the process. Several lines of 
research support this contention. Sachs ( IOo7) demonstrated that subjects were 
unable to recogiii/e syntactic changes In sentences that did not change their 
meaning as readiK as they were able to detect changes in meaning. This suggests 
tiuit people oi teii do not remember the explicit form of sentences expcrienced> 
Other researchers (e.g., Blunientlial, P)67;Mehler, 1903; Miller, 1^)62; Rohrman;. 
\^H^S) argue tliat rather than the surface structure of sentences being remem- 
bered, it is the deep structural relations specified by current tjansfocmatii^nal 
grammars rhat characterize the abstract conceptual knowledge retained in 
memory. 

One impiutant insight that emerges from a -study of such cases is that for 
geneiativc ctincepis there are no tnilv novel instances, [here are only tliosc 
instancies' that are actiral, because thev belong to a generatirr set, and those that 
;ire potential, because ^hey lie dvuriiant among the Feriiairiing totality of in- 
stances. (^Misequeiitly. the i^nly difference between actual, potential.^ 
instances is wliothor ihc instance has Kvii made iiiariit'est by application of the 
gener.itive principle. Once done a newborn instance bears no marks of its 
recent birtli to denote that it is new rather than (dd. 

If the abiwe reasoning is valid, we are able to formulate our lirst empirical 
iivpothesis; it people ()htai}i abstract ef>tieepts then they will not necessarily be 
able to ree(»i:ni:e novel instances (>!' the concept as bein^; novel: that is, instances 
in the i^enerator set nf a concept (i.e., clear-case exemplars ) will not always be 
distini^uishdble from those instamrs never before experienced. 
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In the next soctiDn we review some of the research recently completed at the 
University Dt' Minnesota which lends plausibihty to theHiypothesis that genera- 
tive systems theory provides a precise description of the function of the 
cognitive cipacity by which we obtain abstract concepts. 

EXPERIMENTS ON GENERATIVE CONCEPTUAL SYSTEMS 

. The problem of how people learn abstract conceptual systems is by no means 
new to psychology. Sir Fredrie Bartlett {U)32), in his classic book Remember- 
ing, realized that what people learn nuist be some kind of an abstract system or 
schema rather than a discursive list of simple instances. Clearly concepts can be 
learned from a small set of very special instances, what might be called proto- 
types or exemplars of the concept. Considerable research has shown this to be 
the case. However, in doing so some curious results were uncovered. Further- 
more, the attempt to characterize precisely the nature of prototypic instances 
sufficient for the learning oi'a given concept proved more cU^sive than expected.. 

Attneave (l*^)57a) demonstrated that experience with a prototype facilitated 
paired-associate learning involving other instances of the concept. In related 
research Posner and Keele. {M)68) found that subject^ were able to classify 
correctly novel dot patterns as a result of experience with classes to patterns 
which were abstractly related to the novel instances, :i.e,, related by statistical 
rules rather than by feature similarity. Later,-Posner^ind Keele (1970) isolated 
the following properties of the conceptual systems Avhich enabled subjects. to 
classify novel instances of the classes of dot pattern^: f 1) this conceptual system 
was abstracted during initial experience with theiclasses of patterns, and (2) 
although derived tYom experience with patterns, it was not. base'd upon stored 
copies of the patterns. One week after the original experience with the patterns, 
the subjects' ability to classify the patterns actually seen earlier had decreased, 
while their ability to classify ''new" prototypic patterns surprisingly had not. 
This result supports Bartlett's view by strongly suggesting that these "new" 
instances were classified in terms of a highly integrated system of abstract 
relations {a conceptual, system) rather than being mediated at the time of 
classification by memory of individual patterns. 

The (juestion then is: "how can a subset of instances of a class be used to 
generate the entire class'l*" One avenue that we are investigating, is to see what 
insight the concept of group generator may give into the generative nature of 
conceptual systems: - o 

The notion of a grt)up generator can be understood intuitively by carefully 
studying the illustrations of (he generator :md nongenerator sets of stimuli used 
in the experiment reported below, pHge 207. One should notice that the 
generator set consists of cards whose relations define the displacements figures 
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uruleitit) when orbiting uround tlie center of tlie card, tluit is, wlien tlie ordered 
seciueiicQ oi cards specifies orbiting. On tlie otiierlumd, the no ngencra tor set of 
stiniuji consists of cards tiiat are physically similar to those in the generator set, 
dilfLring, however, in that no.seqaence of these cards is sufficient to specify 
the orbiting concept. At most they specify a displacement of four tlgures over 
the diagonal p^'ath running from the upper left io the lower riglu hiind comers of 
the card. 

In the next section a more formalized account of the group generator notion is 
presented. 

The Concept of Group Generator 

Many e.xamples of the generative property of mathematical grtiups exist. For 
instance, for each integer it is possible to construct a group having exactly /2 

elenicr.ts (a group of order H) by ct)nsidering \,a,a^,a^ \a^\ where 

= tf'V= 1 and the operation is ordinary algebraic multiplication. Such a group 
is called cyclic because the initial element (a^) is identical to the terminal 
element (^/'); the symbol a is called a generator of die group, since eveiy group 
element is a power of^, that '\%a \ a= - , . . . , aX a^^^^ - a" -a^ , 

The (integer) representation of ihe ctincept of a group with a generator is but 
one application of this abstract system. As another example, consider the 
rotatiop.al (cyclical) symmetry of a square. Let each vertex of the square be 
labeled (1,2, 3, 4 J and represented as the bottt)ni row of a matrix. Then let 
each position initially occupied by these vertices be similarly labeled and 
represented in the top row of the same matrix: 

positions iP) (12 3 4) 
vertices (F') (1 2 3 4) 

Wo now define a ^^0 ' clockwise rotatiim of the square as follows: 

/ 1 : 4 \ /I : 4 

M : / ' \4 1 

The 3()f) rotation- of the scjuare can be similarly represented as i'our 90° . 
rolafions; 

i II II! IV I 

/I 1 3 4\ <)()'/] : 3 4 \js() / i 2 3 4\2"(yYr 2 3 Ayaf n 2 3 4\ 

\1 2 3 4/ \4 1 .2 3/ V3 4 ■ I 2 / " \ 2 3 4 1/ " \ I 2 3 4/'' 
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The configurations I-IV are the group elements representing all the possible 
configurations of. a square that can be generated by a product of 90° rotations. 
This can be summarized in tabular form as follows: 



X 


I 11 


III 


IV 


I 


I II 


III 


IV 


n 


ii' III 


IV 


I 


III 


III IV 


I 


II 


IV 


IV I 


II 


ni 



From inspection of the table it is clear that I is the identity element and that 
every element has an inverse, e.g., II X ly = I, III X III =1, etc. To illustrate the 
group operation, (X), by which these products of rotations in the table above 
were computed, consider the way in which one proves that the element IV is the 
inverse of element II sincc^ their product II X IV yields the identity element I (a 
0° or 360^ rotation). 

» . - 

II IV I ' 

fi^ 2 3 /I 2 3 4\ , /I 2 3 4\ 

\4 1 '2 3/ ^ \2 3 4 1 / ^\I 2 3 4/ 

In general, to multiply one array by another do the following: Replace the value 
of the vertex in a giveil position in the first array with the value of the vertex 
found under the position with the corresponding value in the second array. For 
instance, in the above example, II X IV = I, the products are computed as 
follows: F4 in Pi of II is replaced by Vi inP^ of IV; V\ in P2 of II isjceplaced 
by V2 in Pi of IV, etc., where K,- and denote the appropriate vertex and 
position. ■ * 

More importantly (for our purposes), the group of rotations for tlie square has 
two generators, namely II and IV. Either o.f thes?, if multiplied iteratively by 
itself, yields alfelements of the group. Thus, = III, iP = IV, 11^ = 1, 11^ = II 
and similarly, IV" yields III, II, I, IV, respectively. This generative, property is 
not trivial since neither I nor III are generators of the group; I" =1 since it is the 
identity and III" alternates between I and III, never producing II or IV because 
III is its own inverse. Many other groups Kave nontrivial generators. A most>- 
Important group is that'bf perspectives of solid objects. The fact that, for many 
objects, a few perspectives provide sufficient information to specify their total 
shape suggests a way in which perceptual systems, like conceptual ones, may be 
generative. -(Shaw, Mclntyre. & Mace, 1974) 
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The basic strategy for testing the applicability of the group-generator descrip- 
tion in explaining gpnerative conceptual systems is to construct acquisition sets 
which either are or are not generators specifying the total class of instances 
referred to by \\k concept. This suggests the following hypothesis: 

//' tlic information specified in the group generator acquisition set is 
sufficient to allow subjects to generate the entire class, subjects should 
then treat mnrl instances of the class in a fashion similar to the way they 
treat experienced instances of the class, hi contrast, the subjects who are 
given. a non-generator acquisition set should treat experienced and new 
instances of t}ie class differently, 

A Generative Concept Experinrjent 

lo investigate the above hypothesis Wilson, Wellnuuu and Shaw constructed a 
system consisting of four, simple geometric figures (a cnm, i\ heart, n circle, and 
a square) orbilini^ alnne through the four corner positions of a square card. This 
allows for the ctnistruction of sixteen distinct stimuli (i.e., four figures X four 
positions ~ 16 cards). 7hese sixteen cards.;{Ki)vide the underlying set over which 
the concept oiorhiting can be defined by an appropriate ordering of the card^. 
Moreover, the system of relationships among the cards determined by the 
discrete orbiting of the figures, logically specify a group of transformations 
(displacements) that is isomorphic with the geometric group of 90° rotations of 
the s(|uare discussed earlier. By definition two specific groups (e.g., ihc orbiting 
and rotation groups tienoted above) are abstractly equivalent if some third group 
can be fiu.uul U) lepresent each. The numeric arrays, 1-V with the operation X, 
constitute such a group. . - 

The sixteen ca?ds which provide the underlying set for the "orbiting'' group 
can be represented by the numeric arrays I TV as follows: [et the top row of the 
arra\' specify 'the ciuncr positions on a slinnihis cartl while the bottom row 
specilies the figures th:it occur in those positions. In this fashion, the columns of 
the arravs I IV\ reading from lett to right, denote all sixteen cards in the .set 
underl\ing ^the concept ot" orbiting. In the rotation case, each relationship 
betwetm adjacent arrays specifies the new positions assumed by the vertices of 
the square as it rotates discretely thrtnigh by contrast, in the orbiting case, 
the 'relationship luMween adjacent arrays now.provii 's a sunimary of the new 
positions as'Cumed. by each of the orbiting figures from card tc) card. In other 
words, the \>rbitiug of a figure can be thought of as a rotation around an axis 
point outside the figure. Hence they have the same group nuiltiplication table 
and are absliactly eciuivalent. 'i 

The seifuence of cards speeilying a generator for the i d-card sef used in the 
acquisition phase of the expeiiment for one group ol subjects is shown in Fig. 1 . 

Notice tiiat the tlrsl four cards constitute the cohunns of array I while the 
second four cards constitute the colunuis o( array II.lTo see that these eight 
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FIG. 1 (Iroup jjcnerator aaiuisition set. 
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cards qualify as a generator for the total set of cards one need only multiply 
them together in the iterative fashion as discussed earlier. By consulting the 
group multiplication tabic one immediately verifies that multiplying array H (or 
IV) by itself a sufficient number of times yields all the arrays, MV, and 
therefore, is a generator for the. total set t)f cards. Also by consulting the table, 
one can verify that iterative multiplication of array III by itself yields only I and 
IH and, therefore, does not qualify as a generator for the group of sixteen cards. 

There is a sense, ht)wever, in which Hi' is a generatt)r that specifies an abstract 
concept; namely, since the geometric figures occur in all four positions across 
cards, if they are treated equivalently; then they do specify the entire set. In 
Order toniinimi/e the degree of abstraction (i.e., generality) of the nongenerator 
dcquisition set, eight cards were selected in which the figures occurred in only 
two positions, rather than foiir positions specified by HI. This selection guaran- 
teed that the nongenerator acquisition settould not specify the entire concept 
(set) at any level of abstraction. (Although it does contain the generator for a 
system of diagonal relationships.) The cards in this new nongenerator acquisition 
set used in the experiment are .shown in Fig. 2. 

During recognition both groups were shown the eight cards they-had experi- 
enced during acquisition plus the remaining eight novel instances of the system. 
Additionally, both groups were shown nine cards which did not fit the system, 
that i.s, noncasejr. The noncases were constructed by usiiig inappropriately 
colored geometric forms, forms occurring in the center of the card, and forms 
which were {Oriented differently on the card than those in the system, for 
example, a 45'' rotation from the perpendicular. The recognition set, therefore, 
consisted of 25 cards, 8 ''Old" cards, 8 "new" but appropriate cards and 9 
"noncases.'' Subjects were .shown each of the 25 cards one at a time and. asked 
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io rate each card as ''old'' or ''new/' that is, as one they had seen during 
acquisition. 

As might be expected both groups consistently rated the old items as old and 
identified the noncases as new cards. The generator acquisition set subjects rated 
old cards as o|d on Hdv? of the cases and the noncases as new on 99% of the 
cases. 

The two groups were strikingly different, however, in their judgments of the 
new but "appropriate within-the-system"' cards. The "nongroup generator" 
subjects correctly identit^ied these new instances as new' on more than 90% of the 
cases. In marked contrast, the "group generator'' subjects rated the new cards as 
being old 50% of th6 time. That is, their judgiTients pf the new but appropriate 
instances were at a chance level. On 50^,^ of their judgments, subjects identified 
the novel instances of the system as cards which they had experienced during 
acquisition. This group could clearly discriminate system from nonsystem cards, 
as shown by their rejection of the noncases; but they could not consistently 
discriminate experienced instances of the system from novel ones. 

Two conclusions can be drawn from these results: 

1. During acquisition subjects are acquiring infcjrmation about the abstract 
relations existing between the items in the acquisition set. That is, they are 
gaining more information than can be characterized by copies of the individual 
cards they experienced. / 

2. The information specified by the group generator is sufficient to allow' 
subjects to generate the- entire system. This supports the claim that thes^e 
subjects' knowledge of the system of orbiting cards is indeed generative, / 

. ' - 

The fact that subjects in the generator group could not consistently dis- 
criminate between previously experienced and novel instances of the system, 
strongly suggests that subjects are acquiring an abstract relational concept which 
defines, a class of events, not simply information about the specific instances 
they had experienced. Furthermore, this result also suggests that these subjects 
acquired a knowledge of an event (the orbiting of cartls) that is truly generative. 
(More about this type, of event conception will be said in the next section.) 

Assuming that subjects are acquiring abstract relational systems from experi- 
ence with the generator acquisition s^t rather than specific memory of experi- 
enced instances, the question arises as to the elTect of more experience with the 
acquisition set. Concep^tions of memory based upon the abstraction of static 
features, or copies of the experience events, would predict that more experience 
with the acquisition set would facilitate subjects' recognition of new instances of 
the system as actually new, that is, as not before experienced. If, instead of 
storing copies of tiie experienced instances or abstracting the ccimmon attributes 
of the instances, subjects are acquiring information about the abstract relations 
among these instances in the system, more experience with the acquisition set 
would not necessarily result in an increased ability to recognize new instances of 
the. system as bt ig novel. As subjects better acquire the :ahstract relational 
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system they would be more able to discriminate instances of the system as being 
novel. As subje(;ts better acquire the abstract relational system they would be 
more able to discriminate instances of the concept from noncases. However, the 
novel instances of the system may be more difficult to discriminate as new 
precisely because they are instances of an abstract relational system 

To investigate this possibility, four additional groups were run, two with each 
of the two types of acquisition sets. One group experienced the generator 
acquisition set twipe, and a second group three times, Similarly, a tliird experi- 
enced the nongenerator acquisition set twice and the fourth group experienced it 
three times. Following the acquisition phase, all groups were tested for recogni- 
tion. 

In the nongenerator groups, the greater amount of experience' with the 
acquisition set resulted in an increased ability to recognize the new instances of 
the system a.s new. The subjects who experienced the acquisition set three times 
were able to recognize the new instances as new on 100% of the cases. The 
nongenerator subjects were able to consistently identify new instances of the 
concept as new iu.^' one presentation of the acquisition set, and the subjects 
given more experience with the nongenerator acquisition were even more accu- 
rate in this discrimination, However, the results obtained with subjects who 
experienced the grouprgenerator acquisition set were quite different, Not only 
were these subjects unable to identify novel instances of the system as new, but 
additional experience with. the acquisition set decreased tlie subjects' ability to 
recognize new instances as being new. As stated earlier, the subjects who 
experienced the acquisition once accepted the new instances as old 50% of the 
time. Subjects who experienced the acquisition set twice before recognition 
identified the new instances as old on 75% of their judgments, and the subjects 
who experienced the generator acquisition set three times identified the new but 
appropriate instances of the system as old on over 809f of their judgments. All of 
these subjects continued to correctly recognize the old instances as old and 
reject the noncases as not before experienced. 

These results provide strong evidence that subjects are acquiring information 
about an abstr^ict system of relations and not simply information about the 
static properties or attributes of the experienced instances. If subjects' judg- 
ments were based solely upon the attributes or static features of the experienced 
instances, the .subject^ would be able to recognize new but appropriate instances 
as. being new and incrca^se experience should enhance this recognition. As we 
• have seen the results were not obtained, On the other hand, if subjects are 
acquiring a generative conceptual system, then, instances which are appropriate 
to the system would be recognized as familiar. As the abstract conceptual system 
is better learned the subjects' would he more Jikciy to recognize novel instiinces 
of the system as belonging to' the system and, therefore, identify them as old. 

It should* be noted that these data provide strong support for our hypothesis, 
namely, that knowledge of a subset of the instances, of a concept was in fact 
tantamount to knowledge of all instances of the concept. When the system was 
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well learned, subjects could not distinguish old from novel instances. Clearly, 
experience with the group-generator acquisition set was in this case tantamount 
to experience with the entire system. 

Finally, it should be noted that in these experiments subjects were not 
instructed to find relations between the individual instances, nor were they told 
that they would. |ie tested for recognition, Rather, subjects were instructed that 
we were studying short-term memory of geometric forms. Their task was to 
reproduce, by drawing each card in the appropriate acquisition set after per- 
forming an interfering task. In this case, the abstraction of the systematic 
relations between instances of the system appears to be automatic in the sense 
that it was not intentional. 



EVENT CONCEPTS AS GENERATIVE KNOWLEDGE 

In this section we present evidence in support of the contention that event 
concepts arc abstract in nature and therefore generative. 

Shaw, Mctntyre, and Mace (1974) argue that perceiving the nature of events 
involved the detection oP sufficient information to specify their affordance 
structure. The term "affordance" is borrowed from James Gibson (1966) and 
refers to the invariant perceptual information made available by objects and events 
that specifies how animals and humans might adapt to their environments. 

the affordance structure of events consists of two necessary components: 'the 
transformation over which the event is defined (the transformational invariant) 
and the structures which undergo the change wrought by the application of the 
transformation: (the structural invariant). The transformational invariant must be 
perceptually specified ill the acquisition set if the dynamic aspects of the event- 
are to be identified (e.g., th^U the event is ofx running, rolling, growing, smiling, 
etc.), while the structural. iiwariaiit must be perceptually specified if the subject 
of tlie event is to be identified (e.g., what x is: John runs, the ball rolls, the 
JhnKfcr grows, Mary smiles, etc.).^ A set of instances gf an event is not an 

•'Perhaps a better way to darit*y the difference between structural and transformational 
invariants is as folfows: given that John runs, John walks, John smiles, Jolin loves, the 
subject of ali these even-ts is John; the subjecfs structure is what is common or invariant 
and, hdncc, is the structural invariant of ail tlie events denoted. Oi) the other hand, given the 
following events^: John run^v, Bill runs, Mary runs, Jill runs, then tlicre is no common subject. 
AU we know is that some object with a minimal structure to support the operation to. run is 
involved. Tlie operation on the minimal structure .v is the transformational invariant. But 
note that even here to define *that transformation . presupposes some minimal structural 
invariant as its i>ecessary support. A similar argument for the* necessity of postulating 
minimal transformational invariants in order to define structures can also be given. For 
these reasons the affordance structure of events, inclusive of actions and objects, necessarily 
requires both structural and transformational invariants for its definition. Since in ecological 
science uhere^are only affordance structures, that is, animal-cnyironment, or subject-object 
relations, the affordance concept is a universal sem^mtic primitive that deserves careful study 
by cognitive psychologists. - ' • . 
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exemplary set and, therefore, does not constitute a generator set for the event, if . 
it fails to provide perceptual information sufficient to specify both the transfor- 
mational and structural invariants. To summarize this hypothesis: 

All necessary conditions being satisfied, a person will acquire the concept 
of an event when presented with an acquisition set of exemplary In- 
stances (a generator set) because such a set provides the minimal. sper- 
ceptual information sufficient to specify the affordance structure of the 
invent. 

In the experiment discussed in the previous section we showed how a certain 
subset of object configurations quahfiepl' bath formally and psychologically as 
the generator set for an event concept, that of an "orbiting" event defined over 
geometric forms. Thus, the group generator description does seem to offer, a 
viable means of making explicit the manner in which abstract conceptual 
systenus may be creative. 

The "abstract^ concept derived from perceiving the orbiting of the stimulus 
figures ean be analyzed as Ibllows: The generator set in the acquisition phase of 
the experiment consisted of stimulus configurations sufficient to specify a 
subgroup of the displacement group, namely; the orbiting group. This set of 
stimuli constituted the structural invariant of the event while the group opera- 
tion (orbiting) constituted the transform;\tional invariant of the event. The 
subjects succeeded in obtaining the concept! of this event by detecting these two 
invariants which taken together constitute tjie affordance structure of the event./ 

The orbiting group itself provides a descrilption of the relevant aspects of the 
abstract concept of the event. Thus construed, the perceived meaning of tlie 
event Is the orbiting group interpreted over the stimulus structures presented. 
Consequently, we see no way or reason to avoid the conclusion that in all event 
perception situations the existence of an abstract concept is entailed. Under this 
view, the generator for the abstract event concept is that set of instances which 
conveys sufficient perceptual information to specify both the transformational 
and structural invariants defining the event. The meaning of this invariant 
iiiformation for the human or animal perceiver is the affordance structure of the 
event. 

In oi5r opinion, this analysis argues in favor of the hypothesis that perception 
is a direct apprehension ^)f the meaning of events insofar as their affordance 
structure is,'Xoncerned. vSince abstract concepts are generatively specified by (i.e., 
abstractly equivalent to) their exemplary instances (generator set), their acquisi- 
tion can also be considered direct, requiring no augmentation by voluntary 
inferential processes. Similarly, no constructive cognitive process need be pos- 
tulated to explain how abstract concepts are built up out of elementary 
constituents as argued by the British Empiricists since slich elementary con- 
stituents play no necessary role in the definition of the concept. 

Have we made too much of the apparent success of the generative systems 
approach in a singlejine of experiments? It i*s important to ask whether the same 
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analysis can be applieil to a variety of experimental phenomena. We explore this 
p^ossibilit^in thejiext section. 

Perceiving the Affordance Structure of Elaborate Events 

So far- we have presented an example invt)lving ^un '^vent whose affordance- 
structure "can be formally described by very simple group structures, i.e., orbit- 
ing. We would nt)W like to discuss two complex events whose affordance 
structures, although nuu'e t^laboratc, still seem amenable to generative systems 
theory. 

The shape of nonrigid objects. Theories of object perception usually attempt 
to explain the perception of objects and patterns which do not change their 
shape over time. However, a truly adequate theory must also explain the origin 
of concepts of events where object configurations or the shape of objects 
undergo dynamic change. Shaw and Pittenger (/// press) have conducted a series 
of experiments designed to explore this problem The assumption behind the 
le search is this: 

Shape is considered lo he an event-dependent ctmcept rather than an absolute 
pioperty of static objects. This is contrary to the traditional view that identifies 
shape with the metric-Huclidean property of gcometrie rigidity under transfor- 
mation, that is, the'fact that'under certain transformations (e.g., displacements) 
the distances between points on an object do not change. Unfortunately, this 
definition is too narrow since it fails to apply Jo a^manifold of natural objects 
which remain identifiable in spite of being remodeled to some extent by various 
"nonrigid" transformations (e.g., growth, erosion, plastic deformation under 
pressure). \ 

. Biomorphic forms, such as faces, plants, bodies of animals, cells, leaves, noses, 
inevitably undergo structural remodeling as they grow, although their transforms 
retain sufficient structural similarity to be identified. Such forms, like geological 
structures under plastic deformation or archaeological artifacts under erosion, 
are relatively nonrigid under their respective remodeling transformations. Since 
the property of geometric rigidity is not preserved by any of these, it cannot 
provide the invariant ir'^formation for their identification. Clearly, then, a new 
and nunc abstract definition of shape must be found upon which to develop a 
theory of object perception that is btoad enough in scope to encompass all 
objects rigid as well as nonrigid ones, (\msequently, the following dct'inition 
was decided upon: Shape, as an event-perecption eoncept, is to be foniially 
eonstrued to mean the sum total of invariant structural properties by which an 
object might be identified under a specified set of transformations. 

This definition should sound familiar since it is but a restricted version of the 
definition of the affordance structure of objects given earlier. But notice, that by 
tUis definition tlie geometric rigidity of an object under displacement is but one 
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of the many kinds of structural invariants possible. By a careful study of the 
perceptual inforniation used to identify human faces at different stages of 
grqwth (.i.e., age levels), it was hoped that the ge'nerality and fruitfi|ilness of the 
event-perception hypothesis might be further tested. 

Perceiving the shape of fates as a growth event Faces, no less than squares or 
other shapes are dynamic events since their affordance structure (e.g., shape) is 
'derived from a growth process (the transformational invariant) which preserves 

. sufficient structure (structural invariant) to specify the identity, of the. face of 
the person undergoing the aging transformation (growth). In a similar fashion, 
different people at the ^ame stage of growth, can be perceived as being at the 
same age level because growth produces similar effects over different structures 
(Pittenger & Shaw, 1975). These common effects constitute the information 
specifying the transformational invariant of the growth process. Thus, each 
transformation can be idcntiHed by the style of change wrought over various 
objects to which it is applied, . 

In addition to empirically discovering the invariant information specifying the 
identity of the structures (wer which an event is defined, a problem of equal 
'Weight for the event perception hypothesis is to isolaic the invariant information 
specifying the transformation by which the dynamic aspect of an event is 
defined. Both of these htformational invariants must be found in every event 
perception experiment if the affordance stmcture of the event^being studied \% 
to be experimentally defined. Pittenger and Shaw conducted the following 
experimeivts in an attempt to discover the affordance -nructure of the growth 
event defined over human faces. The biological literature suggests two classes of 
transformations for the specification of the transformation of skuU growth: 
strain and shear. A strain is a geometric transformation which, when applied to a 

. two-dimensional coordinate space, changes the length of the units along one axis 
as a transformation of the units along the other axis. For instance, a strain 
transformation can take a square into a rectangle or vice versa. On the other 
hand, ^ shear is a geometric transformation which transforms the angle of 

intersection of the coordinate axis, say from a right angle to something less or 
more than a right angle. Such a transformation might take a square into a 
rhombus. Consequently, Pittenger and Shaw constructed a set of stimuli by 
having a. computer apply different degrees of these two transformations to a 
human facial profile, and then^by photographhig the computer plctted trans- 
forms of the given profile. Three expfiriments were run to test the l^ypbthesis 
that the perception of age level is derived from information made available by 
growth events. ' - * " ' 

To illustrate the application of these transformations to faces, we will describe 
the production of stimuli for the first experiment. The stimuli were produced by 

-applying combinations of these transformlitions globally to a two-dimensional 

Cartesian space in which the profile of a 1 0-year-old boy had' been -placed so that 
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the origin was at the oar hoh» and the v axis was perpendieidar t.) the I-rankfyrt 
hon/urital (a Hue drawn tangent to the top orb of the ear hole and die bottom 
oib i>t the eye sijeket). 

The .iirniula used lor the shear transfiuniution ni produeing the stimuli 
expiessed in rectangukir eoorditiates was r' - \\ x' = .v + tan 0}\ where die tan 0 
is'the angle of shear and .v'. r' are new coordinates. The fornmhi for the strain 
transformation used, expressed for convenience in polar coordinates, was = 0, 
/ ~ ri\ k sin where r is the radial vector and Q is die angle,specifying 
diteclion trom the origin. Here A' is a constant determining the parameter value 
uf the strain. Thus in producing the stimuli tan 0 and k are the values to be 
inatupulated for varying the aniomit of shear and strain, respectively. (For a 
detailed discussion of tlii^' approach see Shaw Pittenger, in press.) The 
calculations were performed by computer and the profiles drawn by a computer- 
ilnven plotter. 

The initral outline profde was transformed by all 35 combinations of seven 
levels of strain (A' =^ -0.25, -0.10, 0, +0.10, +0.25, +0.35, +0.55) and five levels 
shear (^^ -15, 5 *, C>\ +5'\ +15"^ ). These transformations are not commuta- 
tive. Shear was applied tirst. The resulting profiles are shown in Fig. 3. 

Ihese shape changed apprtixiniate thuse produced by j^irowtluWe hypothesize 
tiiat the changes are relevant to perception in two ways; they are a sufficient 
stiriiulus tt>r tlie'perception of age while at. the same time leaving information for 
the idetHitv of tlie face invariant. The reader will note, however, that profiles on 
.the extreme "vlilitt?^ tor each variable are quite distorted. These values were 

^Strain Level (k) 
.10 0 10 - .25 .35 .55 

15 
o 
IS 

FIG. 3 1 r ni>{unn.ith>n <\ f.ui.il prntilc h\ shear .iiul strain. 
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chosen to test the supernormal stimuli hypothesis. Supernormal stimuli are 
produced by exaggerating some relevant aspects of a stimulus, Eithologists claim 
that such stimuli lead to exaggerated, respoijises (Tinbergen, 1^)51). 

Experiment 1 ^ 

Tp test the effects of the shape changes induced by shear and strain the profiles 
shown in FMg. 1 were presented by slide projector to the subjects in a task 
requiring magnitude estimates of age. The subjects were instructed (o rate the 
ages of tliQ profiles by choosing an arbitrary number to represent the age of the 
first profile and assigning multiples of this number to represent the age of 
succeeding profiles relative to the age of the first. Twenty subjects were asked to 
rate the 35 slides resulting from the transformations described above. The results 
were Ntraight forward. Using a Monte Carlo technique Pittenger and Shaw found 
that 91' ; of the judgments made by the subjects agreed with the hypotheses that 
the strain transformation produced monotonic perceived age changes in the 
standard profile. On the other hand, using the shear transiormation to predict 
judgments produced only 6f/v agreenierit. Since strain was by far the strongest 
variable of age change, we decided to test the sensitivity of subjects to very small 
changes in profiles due to this transformation. 

Experiment 2 

Sensitivity to the shape changes produced by the strain transformation was 
assessed in the seeond experiment by presenting pairs of profiles produced by 
different levels of the transformation and requiring subjects to choose the older 
pcofile in each pair. A series of profiles was produced by applying strain 
transformations ranging from k = -0.25 to +0.55 to a single profile, where k is 
the coefficient of strain used m the equation controlling the computer plots. 
Highteen pairs of. profiles were chosen; three for each of six levels of difference 
in degree oi strain. The pairs were presented twice lo four groups of ten subjects. 
Different random orders were used for each presentation and each group. 
Subjects were informed that the study concerned the ability to make fine 
discriminations of age and that for each pair tliey were to choose the profile 
which appeared (o be ohlcr. During the experiment they were not informed 
whether or not their responses were ci^rrect. By correct response we mean the 
choice of the profile with the larger degree of strain as the older. 

Several results were found. An analysis of variance on percentage of errors as a 
function of diftcrence in strain .showed a typical psychophysical result- a dechne 
in accuracy with smaller physical differences and an increase in sensitivity with 
experience in cthe task. However, two other aspects of the results are more 
important for the question at hand. First, subjects do not merely discriminate 
the pairs consistently but choo.se the profile with the larger strain as the older 
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p;iirile with greater tlian chance fioquency: in tiie lirst presentation the larger 
strain was feieeted on 83.2'7 of the trials and the second, on 89.2% of the trials. 
In each presentation, each of the 40 subjects selected the profile with tlie larger 
k as older t)n more than SiY ' •>r the tnals. In lUher words^ the predicted effect 
was obtained m every subject. A sign test showed the change probability of this 
last lesuH to be far less than .001. Tluis, the conclusion of the first e.xperiment is . 
confirmed In" a different experimental task. Second, sensitivity to the variable 
proved to be surprisingly fine. 

Experiment 3 

A tliird experiment was designed to determine if a structural invariant existed by 
which individual identity might be perceived as follows. We have all had the 
expetionce (»f tecogni/ing someone we know as a child years later when they 
have grown to maturity. As a preliminary test of preservation of identity under 
the strain transformation, profile views of the external portions of the brjiin 
eases of six diflerent skulls were traced from x-ray photographs and subjected to 
live levels of stram. F'ive pairs of transformed profiles were selected from'each 
individual sequence: the degree of strain for members of three pairs differed by 
0.30 and those of the other two pairs by .45 values of A:. A profile of a different 
skull was assigned to each oi" the above pairs which had the same degree of strain . 
as one of the members of the pair. Slides were constructed of the profile triples ^ 
such that the two profiles from distinct skulls wliieh had the same level of strain 
appeared in random positions at tJie bottom. Thirty subjects were presented the 
slitles and asked to select which of the two profiles at the bottom of the slide 
that appeared most similar to the profile at the top. The overall percentage of 
errors was low: for the 3(1 sets of stimuli presented to 30 subjects, the mean 
error WHS less than 17', '. with no subject making more than 33% errors. Since no 
subject made 50'' or more errors, a sign test on the hypothesis of chance 
responding (bimunial distribution') by each subject yields a probability of far less 
than 0.00 1 . Indeed, in another set of studies. Pittengcr antl Shaw also found that 
people are ijuite able to rank order by age photographs of people taken* over 
nearly a decade of growth from pre- to post-puberty years. 

The results of these three studies provide support for two important hypoth- 
eses- the siiam transti^rmati(Mi due presumably to growth, not only provides the 
major source o[ the relevant perceptual hiformatitm for age" level, but also leaves 
invariant sufticient perceptual information for the specification of the individual 
identity of the person by the shape the head alone. 

These expernnents also support the contention that the perceived shape of.an 
<)bject is iKu simply the shape of a static, rigid object, but is rather a higher order 
structural invariant which remains relatively unchanged by the events (i.e., 
transformational invariants) into which such objects may enter. Fnirtiier dramat- 
ic support for this claim is pr(Wided by the fact that the, identity of human faces 
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is preserved under elastic transformations as distinctive from growth as artistic 
■characterization. The success of political caricaturists rests on their ability to 
satiri/e a political figure by exaggerating distinctive body or facial features 
without obscuring the identity of the famous or infamous personage depicted. 
Indeed, there is evidence that such an artistic redition of complex structures 
facilitates their indentification (Ryan and Schwartz, 1956). But will the event 
perception hypothesis apply equally well to still more elaborate events in which 
coqiplex transformations are defined over a variety of structures? 

Perception of a tea-making event Recently, at the Center for Research in 
Human Learning, Jerry VVald and James Jenkins have been investigating the 
generative nature of an elaborate event: the act of preparing tea^ To study this' 
event 24 photographs were taken depicting the various steps involved in the 
preparation of tea. These stimuli were presented to subjects following the same 
experimental design used in the ''orbiting" event experiment discussed earlier. 
Sixteen of these 24 pictures were used as an acquisition set portraying the 
tea-making event to subjects. Later, these 16 pictures, plus the remaining 8 from 
the original set, were shown to the subjects, who were asked to indicate whether 
the picture was new or one which occurred during acquisition. The subjects were 
unable to distinguish the new but appropriate pictures of the event from the 
pictures they had actually experienced during acquisition. Once again we see 
that a partial sub.set of the possible instances of an event can specify the entire 
event. 

The general results found in this experiment were essentially the same as those 
found in the ca.se of the "orbitings-event experiment reported earlier. Namely, it 
was again found that siibjects were very good at recognizing as new pictures 
which were physically similar to those in the acquisition set but inappropriate as 
elements in the event. For example, if a type of movement or direction of 
movement inappropriate to, the event portrayed during acquisition was depicted, 
subjeqts classified the picture as new. Clearly, the knowledge which subjects 
gained during acquisition was knowledge of an abstract system of relations, that 
is, an event, not^ knowledge of exact copies of the exemplars specifying the 
event. Additional supporl for the contention tliat subjects are acquiring a 
generative system of relations is provided by the finding that subjects who were 
provided more experience with the acquisition pictures were even more likely to 
mi.stake the novel but appropriate instances for tliose actually seen. 

GENERAL CONCLUSIOIMS, AND 
IMPLICATIONS FOR INSTRUCTION 

Each of the event perception experiments discussed is not only arnenable to a 
generative systems explanation but seems to require it. The range of events 
surveyed, from simple events such as orbiting objects, to more elaborate events 
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involviriii giowlh of human faces arul the preparation of tea, suggests that the' 
abihty to forriuihite abstract concepts is a basic cognitive capacity un(j<>rlying 
knowledge acquisitio'n. This characterization of knowledge acquisition has sever- 
al Muportant implications for a theory of mstructiou. 

The niost general implication concerns how we should conceptualize llie 
nature of those situations in whicFi we accrue useful knowledge about our 
natural, cultuial, social, and professional environments. If the majority of our 
experiences in these ureas involve encounter,s with either novel instances of old 
events or fresh instances of new events, then the goals on instruction must go 
beyond concern for how particulars may be learned. Rather, the primary goal 
should be to train people io exploit more efficiently their ctignitivc capacity to 
assimilate knowledge that is abstract and, therefore, generative. 

Moreover, if adaptive responding to even ordinary events, such as recognizing 
faces nr making tea, entails generative knowledge of abstract relationships, then 
this is all the more true for dealing with higher forms of knowledge in such fields 
as science, philosophy, mathematics, art, history, or law. Acquisition of knowl- 
edge in aP areas is a result of abstraction over well chosen instances of events, 
the exemplars which instantiate the generator sets for the concepts involved. 
Accepting these conclusions, what ptitential impact might such a cognitive 
theory of knowledge have upon current educational practices'? 

- I, Programs of instruction should primarily consist of lessons in which stu- 
dents are furnished with direct experience with those core concepts of the field. 
As we saw Hi the case of the experiments reported, the abstraction of generative 
systems requires first-hand experiences with those exemplary instances of a 
concept that constitute its generator set. However, our educational institutions 
typically, and sometimes exclusively, use the "lecture" technique by which 
students^'are made passive recipients of the coiiclusions or implications drawn 
from another person's ' experience, where in actuality some version of the 
experience itself would be a much better form of instruction. Instruction, which 
takes the fnim of learning facts or priticiples about sonic concept A', is not a 
substitute (although it may be a useful supplement) for acquiring direct experi- 
ence about concept .v, even if presented in some analogical or simpler proto- 
typical form. This is why some courses of study wisely rely heavily upon 
laboratory or field experience, l^uleed, every classroom'should be a "laboratory" 
for first-hatuK lalher than. second-hand experiences. 

There is little new in the above observations regarding the preference of active 
participation in thx? learning process over passive reception of material to be 
learned. What is new, however, is the insigiit that the generative capacity to 
formulate abstract concepts may he naturally engaged when the student experi- 
ences a very special subset of exemplars, numely, the generator. Therefore, the 
selection of the exemplars of a concept to be taught is a very different affair, 
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requiring the joint efforts of cognitive psychojogists and instructional experts. 

2. Another, related implication of the generative characterization of con- 
ceptual knowledge is to offer a new theory of the transfer of training effects so 
desirable throughout the educational progress of n student. How do old concepts 
fa^jilitate the learning of n6w ones; and how does new information become 
integrated with existing information? 

Since, the generative nature of knowledge has not been seen as implying a core 
cognitive capacity, both specific and general' transfer have been seen as a second- 
ary, 'spin-off effect of learning specific reactions to specific objects or events. We 
have attempted to show throughout this chapter Avhy this characterization of 
learning is backwards. The generative cognitive capacity that is responsible for 
transfer is not derivative from or based upon knowledge of exact replicas or 
copies of experiences. It is the abstractness of concepts that accounts for the 
generality or transfer of conceptual knowledge gained in one situation to new 
, situations. Transfer, therefore, is inherent in the acquisition of abstract concepts. 

3. A final implication of this theory for instruction related to the selection of 
, . criteria for evaluating performance as an indicant of the state of conceptual 

kaowledge attained by the student. This has proven to be a most difficult and, 
somewhat surprisingly, a most controversial issue. The proposed theory suggests 
why this^is so. 

A major source of difficulty in the evaluation of the knowledge a student has 
acquired is to know what types of performance count. There are several 
performance levels students may attain due to either their sophistication in an 
area, their motivation, or the nature of the concepts to be learned. First, and 
easiest to evaluate, is the ability to verbalize, or articulate in some other overtly 
demonstrable form, exactly what they know about a topic^ Unfortunately, this 
level of performance is exhibited inadequately by most people and tends to be 
rare except for simplistic cases where a rote memorization of particulars is 
appropriate. Such knowledge, howeyqr, is not necessarily generative in nature 
and, thus, its successful evaluation poses no guidelines for an adequate evalua- 
tion of students' abilities to use abstract conceptual knowledge. 

A second and more frequently exhibited performance level is that the student 
has attained useful knowledge of a topic but is unable to articulate what he or 
she knows. Clearly, a very im|)'brtant goal of education is to bring a novice in 
some subject matter area up to the level of an expert. Indeed, often we would be 
very happy if our pedagogical attempts had even more limited success in that the 
* student somehow learned to make sound judgments although remaining unable 
to articulate theblisis for the judgments. 

This state of affairs, rather than being rare among experts, is actually very 
common. Few experts can specify, in algorithmic clarity, the reasoning process 
they go through in order to arrive at a sound judgment with respect to a problem 
in their area of' expertise, althougli they may present a learned rationalization 
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ufterwavils. Many art cdnnoisseirs are ahle io distinguisli styles of artists, cate- 
gorize according to era, culture or school, various artifacts presented to them 
without benig ahlo to say " he forehand the criteria they use. Similarly, chess 
masters intuit outcomes of gaiiies and strategies of opponents without being able 
to specify a priorj criteria for doing so. Indeed, in all areas of knowledge, to be 
an expert is synonymous with the ahihtv to render objectively sound judgments 
Without necessarily being able to specify every step in die ratiocinative process 
invtjlvciL If it were not so difficult to do so, educating novices to the level of 
experts would only require rote memorization of algorithmic judgniental pro- 
cedures applied to rotely memorized hanks of data. 

The intuitive judgments of experts do, of course, pronndgate from a. knowl- 
e.dge basis, but one that is usually more tacit th;in exphcit. In short, expert 
judgments are a by-product of generative systems of-knowledge rather than of 
inert ilata banks of f,-ictual information. Consequently, in our effort to evaluate 
how much closer to an expert's judgmental ability education has moved novices, 
we want to assess primarily the degree of generative, tacit knowledge they have 
obtaineil ami n*tr just their explicit knowledge of itemized facts. Based on the 
current theory and findings, we suggest that the following questions should be 
answeied by any knowledge evahiation procedure: 

a. Can the student identify the same set of cleaf-cases of the concept that a 
inajo'riiy of experts agree upon? This includes also the ability to distinguish 
non-cases from true ca.ses.^, 

b. Will the student, once tutored in the concept area, select a prototypical 
instance of tiie concept from a recognition set of instances as being most likely 
an instance previously studied, even though it was, in fact, never seen? 

c. Can the student deal with mwel instances of the concept with the same 
facility shown with familiar ones? And corollary to both (U) and (c): 

d. TDoes the repeatedly tutored student display an inability to recall whether 
he or she has seen relevant particulars about the concept area before, while at 
the same exhibiting considerable confidence diat irrelevant particulars \vere not 
seen before".^ This is a very important criterion for determining if the student has 
indeed budt up tacit knowledge structures that are not accessible to conscious 
articulation, hi fact, the proportion of fals^^ positives in recognition tests may 
provide the t)nly way to delerniine whether an inarticulate student has neverthe- 

. less gamed sufficient knowledge for nuiking sound intuitive judgments (on the 
assumption, of course, that a comparison of the students' judgments with tiiat.of 
experts is not directly feasible). 

Obviously, tliere is still much work to be accomplished before drawing any 
final conclusions ahoiu the proposed theory. It already exhibits, however, in our 
opinion, sulficient promise in both theoretical and practical areas to merit 
further development by both cognitive and educational psychologists. 
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From 1967 -to 1971, when I was writing Cognitive Processes in Education 
(Farnham-Diggory, 1972), I was largely alone in attempting^to relate informa- 
tion-processing psychology to education. That has now changed, and the 
chapters in this volume represent important new contributions to t^ie area. The 
chapters also reveal awareness by this group of distinguished scientists of what a 
big job they have undertaken. Really understanding.educationaI problems^ really 
-analyzing the psyclioiogical processes involved, really distilling and applying 
psychological principles, are enormously complex tasks-only recently under- 
taken by theorists capable of coping with them. Prior to the last decade, the best 
theoretical minds in the business were working on problems derived from 
relatively simple learning theories of the day. Such theories were not adequate 
for the proper study of instructional behavior, although 'they ^weTtri:hallenging in 
other ways. F-inally, there emerged a theoretical framework— the information- 
processing framework- complex enough to fit the real world of education. As a 
result of this development, and of the caliber of scientific though it is fostering, 
the next 10 or 15 years of psychological research should produce major new 
insights into instructional issues. 

For this to happen, however, our theories must push well beyond the descrip- 
tive level whidi is to say, they must generate testable predictions that a smart 
educator, flying by the seaj of his pants, would not be likely to make. As Carroll 
(Chapter 1, this volume) has noted, most educational theory today has the form 
of cultural tradition pas.sed on by word of mouth. Educators trust this tradition 
because it^ provides them with hand-holds. But we know it will not get them 
where a good theory will get them. The relation between intuitive practice and 
good theory is analogous to crossing a stream by following a personal map. from 
rock to rock, and crossing by means of a properly engineered bridge. Unfortu- 
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nately, much of psychology, purporting to build the bridge, may be merely using 
a different hinguage to describe the process of getting from rock to rock. We can 
see this by attending to the descriptions of good educators who are not familiar 
with psychological jargon. *- * 

An especially useful and humbling book iu this regard is one written by a man 
numed Charles Allen (MM^)), described on the llyleaf of his book as ''Sometime 
Agent for Industrial Training of Hoys and M6n, Massachusetts Board of Educa- 
tion, and SuperiiUendeni of Instructor Training, U. S/S. B. [United States 
Shipping Board] Emergency Fleet Corporation/* Mr. Allen was born in 1862, 
and this fiook, which was obviously a culmination of 30 or 40 years of 
experience, was published in \ ^U^). Although- some of the PavUwianTWa.tsonian, 
and (Jestalt psychological principles were around at that time,' Allen was inno- 
cent of tliem.' He told it like it was. without benefit t)f any such newfangled 
nnnscuie. -Ih,^' title of his book sets the straightforward U)ne. It was called 'The 
Instructor, tfie M.m. and the Jvib." Let me give you some examples of Allen's, 

• uistructuMial wisdom: 

WluUcvor tlig instructor iiUcnds to put over tn tliv' Iciifntr must be given to him in 
suMu" ttfilor; It cannot he LMven to !nm ail at once. t1iis hf-in^^s up the ijiiestitMi as 
to ... whether there is not a hest insfnu tional orJcr . . , andy if so, how it eaij be 
determined. ' 

An ett'ectivo i>rder instruction . . .presents certain characteristics among the more 
im[H'.rtant of winch are: 

I I he ditiereiil leaching jt)bs . . . are sc) arranged that . . \ each sueeeediiig job extends 
the learner's knowlediie and skill, biu does not call for a different sort of knowledge and 
skill. ' • ' " 

• 2. lobs that retiuire the learner to tliiiik 6\' the least pumber of different things lit 
once come fifst and ji)bs that require the learner to think of the most different things 
come last. 

3. The jobs are arran^^ed accordinii tii the diffieulty of learning how to do them rather 
Ih.m accordinj^ U\ tlie order in which thoy would be done in getting out a finished 
' [U'lduct . . . That is, ihe order is an instnivtion (irdcr. not w produi'tion order. 

. . . An illustration i)f a course of instruction wliieli does not meet these conditions 
would be die t'oHowiii^ procedure.. . . Where two rivet holes do not eonie together 'fair', 
tliov must be reamed to a common si/e. This is usually done with a pneumatic gr 
eloctru ilrive . . A Liroup of men after having been cautiohed as to the control of the 
machme were placed in compartdicnts of the ship to ream out all holes that required 
reamiMv'.""rhose iioles were, ol course, all sizes, fair and unfair . . . Some could be reamed 
.in easy p(?sitions and some required ditTieult positions. Under drese conditions the 
learner was immediately put up against jobs of all .sorts of diffieulty, since he took the 
holes as they came. He worked in diis way untit he had learned to ream. Under these 
conditions the k\irner had t(/ learn too many diings at once, reducing the probability 
tliat he would tluiroughly any one thing, causing a state of nantal confusion and 

slowing upilie learnijig operation . . . Under a properly arranged order of instruction the 
work would have been so laid (ur that holes of different degrees of fairness would have 
been marked so that the learner fir*ft learned to ream the fairest hole, Uien the next 
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fairest hole, and so on up to the most unfair hole that he would ever have to work on. 
Moreover it is very unlikely that One compartment would afford enough samples of 
holes of all degrees of fairness, so that instead of keeping him in one compartment till all 
holes were reamed, he should have been carried from one compartment to another as 
the demands of the training required . . . Keeping the gang that is under instruction in 
one compartment till it is all reamed up gives good production conditions; such an 
arrangement is an example of bad instructional conditions. 

As between the two methods of training given above,^the latter would train a reamer 
mueh faster, make a better workman of him. keep him in a much better frame of mind 
while he was under training and turn him out with a much better attitude toward^ his 
job (Allen, 1919, pp. 78--80, italics Ills]. ^ 

• We can Hst many psychological principles contained in Allen's specifications. 
From 1918, four decades of discrimination learning theory would have been 
applicable. But would it have dor\e any more for Allen than he could havo done 
for himseir even experimentally? Without, benefit of stimulus-response jargon, 
Allen coul'd have, and prt)bably did, run a crew through the ordered procedure 
that he recommcruled, run aii\other crew through the unordered procedure, and 
measure resulting wt)rk skills \md attitudes-sufficiently well to make money- 
saving decisions about training procedures. Traditional discrimination learning 
theory would not 'have expedited such an empirical program very much. It 
would not have built a bridge, but would merely have renamed some of the 
•empirical pr4.)cedures. Can modern information-processing psychology do any 
better? Can it provide new information, new guidance which a smart instructor 
would not be able ;to get for himsell"? Or are we also just renaming some 
phenomena? 

Let me give you another example. Allen outlined in detail the. necessary steps 
for performing what we would call a task analysis. For any given block of skills^ 
(for example, those of house carpentry), the instructor was to decide what the 
progression factors were (Allen's term). What had to be increased? What had to 
be decreased? For. example, fear of. working at a height had-.to be decreased in 
houfe carpenters. Accuracy of measurement and placement had to be increased. 
The number of operations to be remembered and performed had to be increased, ° 

Having designated these progression factors, the instructor was the^i to allocate 
jobs whii^h matched the levels of progression. For example, the very first job 
should keep the man on the ground, require easy, gross measurements, and only' 
a few opeVations. Paper work met those specifications- the man stands on the 
ground, hangs up creosotbd paper, cuts it off at the bottom, and nails it on. At an 
intermediate level, Allen got the man up on a stage or scaffolding, and'had him 
do clapboarding- which required more precise measurement and a larger number • 
of operations. At an advanced level, the man was placed on the roof, nailing 
down shingles. 

Tjie instructor was to work this out by putting al) the carpentry jobs on file 
cards, and fitting them into a diagram like that shown in Fig. 1 . The OsVefer to 
checkpoints, or tests, which the man mu,st pass before he moves on to the more 
advanced levels. 
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FIG. 1 Task analysis chart used by Allen in designating steps in the training of house 
carpenters (AUpn, 1919, p. 90). 



The question again is: do our modern methods of task analysis really add 
anything to this? Or have we merely restated in fancier and more detailed jargon 
what good instructors already know? That is, are v/e helping these insflruttors in 
any way? 

Two brief final examples, more cognitive in nature. Allen talks about the need 
to teach special technical terms and skills on th^ job, rather than in some 
preliminary chisswork— which is what he says most lazy, inexpert instructors 
would rather do. Allen calls this knowledge mixiliary material, and says: 

... If [auxiliary material} is given him in advance of the job he has nothing to *tie* it 
to; it makes but little impression. If it is given him'after tlie job he has not been given it 
when he has a chance to apply it. In cither case, what * tying* he can do will be to such a 
general idea of the situation as he may get from such general knowledge of the job as he 
may have picked up somehow . . . a .pretty Weak thing to tie to ... In order that he shall 
think of the thing in question when he should, he must have gotten it in connection 
with some operation, so that, whenever he performs that operation the thing, §ay.., 
*shooting the tool,* will come up in his mind in connection with that part of the job. It 
is the failure to recognize this fact that makes so much 'preliminary ' w6rk in^the 
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fundamentals' of so little value; general talks on safety first are given and then, when the ' 
men on the job d:) exactly what the instructor -warned them not to do, he wonders what 
is the matter and calls them stupid. He puts up lessons on fractions, and then finds that 
his men do not know h^nv to use fractions on the job; he teaches trade terms in advance 
of their use and, when tliey coir.- up on the job, ^he men do not know their terms. In all 
these cases, tlie trouble is that the instructor, who has plenty of trade experience to tie 
to; forgets that the learner has little or uojip; it is another case of the instructor thinking' 
of the problem with his own brain and not putting himself in the place of the learner 
[Allen, 1919, p. 103). 

Allen calls this correct metliod of Instruction the tying up method, and 
provides specifications for exactly iiow the instructor is to carry this out, how he 
siiould decide what the auxiliary material is, how he should time its introduction 
on- the job, and so forth. , 

A final example lias to do with the very interesting perceptual problem of how 
you know a rivet is hot enough. Before introducing this problem Allen dis- 
courses on what we would now term the ^(ycm^/c me^Aoc/ of questioning. Allen 
miglu not have known that term, but he did know his man had:to be tauglit to 
think, and that the only way to do that was to get his mind gohigl 

In explanation it may be stated that, in riveting, the rivets are driven hot. They are 
heated in a smali portable furnace or forge. A part of the job of the ^heater boy' is to 
pick out rivets at the right heat for driving. If too hot they are ^burned* and should not 
be driven. If too cold they will not, drive properly ... The heater boy is paid for 
knowing how; to pick out a rivet at the right heat, 

. , . In planning a lesson the instructor has three questions to answer. First, what are 
the ideas to be put over in the teaching unit? Second, what is the teaching base or 
*jumping-off point' (J.O.P.) that is proposed to be used? Third, what ideas already in the 
learner's niind does the instructor intend to utilize in carrying the learner up to the 
J.O.P.? ... A few general rules can oe given. 

Work from the qualitative or general notion to the quantitative or exact notion, 
always ask 'how' or 'what' before asking Miow much' ... General ideas should be 
presented before specific ideas. For example, the idea that the rivet must be at a certain 
heat to be right will be put up before the idea that tlie right color is just under a white 
heat. 

. . . In order to put over these ideas, the learner must be made to have in his mind a 
certain group of ideas or a picture to serve as a foundation for the building on of the 
new idea contained in the teaching unit. In this particular lesson, a good J.O.P. is to have 
the learner thinking of the problem of knowing when a rivet is hot enough. 

[To build up the J.O.P., the instructor is to ask such questions as the following:]. 

hirst Uica. (A rivet) 

I. Have you ever seen a rivet? 

2'. Can you tell a rivet from a bolt? ■ 

... ^ 

Second Idea. hoi x\\Q\.) 

1. Could you pir,k up a rivet that you found lying around the yard? 

2. Could you tell a very hot rivet from u cold rivet without touching it? 

Hiird Idea. (A rivet heated enough) 

1. Can a rivet be heated to different heats? 

2. Would it make any differenct what heat a rivet has, provided it is hot? 
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3. Hasn*t the heater bay got to know- somehow when the rivet is at the right hciit? 
J. 0. P. How does he know when a rivet is just hot enough? 

(Training then includes such experiences as: 1 ' ^ - 

(Place rivets in fire.) Have each boy pick out correctly heated rivets, meantime asking 
such questions as are sugge'sted below, of the other boys^ 

Bill; Pick oat a correctly heated rivet. 

Sam; Did he do it?" 

Jack; How do you know he did it? 
" Toip; You pick out a rivet. 

Jack; You watch him. 

Sum; Pick out another one. 

Bill; That wasn't right, was it? 

Jack; Pick out a burnt rivet. 

Carry on work of this kind .until satisfied each boy knows a properly heated rivet 
lAilcn, 1919, pp. 184-195). 

riie qucstu)!! is; ain we, 50 years later,, improve tiuit instructional program 
throiigli otir knowledge of the psychological principles involved? The answer, T 
think, li^yes. Wiii>.^ it is true that psychologists do ;not pay enough attention to 
the work of good educators, it is also true that edijcators have not been able to 
solve many of their own problerlis, or even to r^ognize wiien some of the 
solutions were at iuind m. their own Experience. Tli^ fact'^that we recognize the 
importance of Allen's insights is a sign tiiut our own theories are mature>enough 
to match up to good, instruction, and move it further along. o. 

Let us consider some o\' the principles tiiis volume lias offered. 



DYNAMIC THEORETICAL MODELS' 

o 

All four of the cliapters under discussion here stem from dynamic theoretical 
positions. They are concerned with changing conceptual fields. Shaw anci Wilson 
'(Chapter 10, this volume) have attempted to account for the well-known human 
capacity to generate unlimited new instances of a concept. Where does the 
criterial rule come from? How is it learned? Shaw and Wilson argue that it is 
discovered inductively as a result of experience with a critical set of conceptual 
exemplars-the generator set. They present data siiowin^ that subjects will learn 
an abstract system of reiati'ons, not merely a list of static properties, if they 
practice on tlie generator set. Although Allen (1919) undoubtedly recognized 
this principle, lie was .far from formulating pr cise predictions regarding its 
nature. Instructionally, the implication Is straightforward and important: if you 
can teach on'ly one case of a complex concept, which one will you choose? The 
research carried out by Shaw and Wilson, along with that of the other prototype 
theorists, Rosch (T973a,b), Reed (19.73), and Lockhead (1970, 1972) points 
toward the day when that question can be- answered scientifically rather than 
intuitively.. . 
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The Hyman study (Chapter 8, this volume) begins, in elTect, where the Shaw 
and Wilson study entled: with a fully formed concept, that of a professional role. 
Hyman was concerned with the power of such a stereotype to distort recog- 
nition memory for trait adjectives. This, again, is a dynamic theoretical con- 
ception. Hyman's data show that concepts actively inlluence recognition 
memory: In Allen's world, that could mean false recognition of a heated rivet 
whenever n trainee held a strong preconception of appropriate rivet character- 
istics. True, Allen was prepared tor false recognitions, and he structured the 
instructional situation accordingly. But Hyman's research points the way to- 
ward exact scaling of characteristics that a student must learn to notice, and 
exact predictions about the extent to which prior learning will affect detection 
skills. 

The I SR network, as described by NormUn, Centner, and Stevens in this volume 
(Chaptor ')) and clsewheie (e.g., Norman, 1973; Lindsay iS: Norman, 1972) is a . 
fully dynamic theory ot how memory is modified by the new. demands that are 
made upiin it. In the l.NR network (as in the networks of Collins & Quillian, 
U)72; Scluink, H)72, and Anderson & Bower, 1973) concepts can be represented 
as object-relation-attribute constellations. Tliese constellations are not fixed, but 
..can be formed and re-formed as the occasion demands. Norman, Centner, and 
Stevens provide several examples of the mental restructuring that takes place 
during tutorials. The interaction between the experimenter and the student in 
the Jump Problem (pp. 192-193, this volume) ^would probably have been 
especially appealing to Allen. One imagines that he would have admired the 
systematic protocol analysis, tlie step-by-step printout of changes in the stu- 
dent's programming rule. Such detailed analysis is the theoretical groundwork 
necessary to the discovery and bracketing of critical teaching moments. Even- 
tuully, we should be able to define Allen's J.O.P. (''jumping off point") as 
rigorously as we can define the critical heat of a rivet. 

Greeno (Chapter 7, this volume) illustrates an application of LNR theoretical 
principles to a lesson in psychophysics. Again, we see how knowledge can be 
represonttH^ as a set of dynamic interrelationships. Greeno also asks, in this 
section ot his chapter, what higher-order goals and constraints affect student 
performances. Essentially, we can say that there are rules affecting entry into, 
and use of, the conceptual network (Lindsay &-Norman, 1972). Before answer- 
ing a ipiestion about the facts of psychophysics, one must answer the question: 
What kind of an answer does the instructor want? Nowhere are such meta- 
strategies considered by Allen. 

Additmnal facets of Greeno's chapter will be discussed in a later section. 

In summary, we can say that our modern teclinological and theoretical capacity 
to represent ehanging conceptual states is ' a major advance in instructional 
theory. By virtue of this capacity, we can work toward the precise specification 
of (fl) key instructional concepts that will have maximal viability and generality; 
(b) the rate at which new information will be assimilated to, or distorted by, old 
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information; (c) critical teaching moments; and (d) rules governing the way in 
winch organized knowledge is accessed. 
Now we turn from consideration of dynamics to consideration of structures. 



I'ach of the chapters under discussion here has evidenced concern with mental 
organi/alions described as schemata. It is clearly the case that all cognitive 
theories of instruction will post.uhite higher-order schemes governing both the- 
learner's potential and the teacher's strategies. 

Shaw and Wilson have diseusscd the relational schemata underlying judgments of 
aging. As infant faces were geometrically transformed, certain feature relation- 
ships remained invariant. This invarianee ct)uld be called the identity schema; the 
transformational invariants themselves comprised a^^ing schema. 

Hyman has suggested that schemata function as intervening stages in a recogni- 
tion task. The perception t)f a trait, or a tiait name> evokes a broad personality 
stereotype. This stereotype, in turn, increases the probability that other traits 
asstieiated with it will he noticed, and even falsely recogni/ed. Norman, Gentner, 
and Stevens consider schemata io be the basic units of memory. For learning to 
have occurred, relevant schemata that is, schemata similar to those activated by 
the learning situation must have been modified or recombined. Their "Mayon- 
naise Problem'' illustrates how subjects summon schematic analogs to cope 
with task demands. Mayonnaise must be made of something that h)oks white and 
tastes spicy, hence it must be made of whipped cream and mustard, Greeno's 
higher-order issues are actually schematic issues. Selecting the right form for an 
answer to a question is selecting a schema; deciding how specific to be, is 
deciding about the potential applicatitin Of a schema; learning *\vhat counts as 
an explanation of something [p. 156]" is learning that "an explanation is 
organi/ei^l according to rules, and these rules constitute a schema that must be 
juil ol the student's knowledge [p. 156| 

Formulations ot this tv^)e, and the experiments delineating them, have moved 
modern instructional science well beyond Allen's ''tying up method." However, 
because we try to educate masses of students simultaneously, there remain 
massive discrepancies between the available schemata of learners, and informa- 
tion presented by teachers. That is one aspect t)f what J. McV. Hunt (1961) has 
called ''the problem of the match." 

There are many different ways in vvhicli the term schema is now being used 
throughout psychoU)gy, Although this must trouble theoretical purists, it has an 
important implication: it indicates widespread scientific attention to the fact, 
that our heads contain higher-order units and capacities. Almost everyone, it 
seems, has left his little S-R links by the wayside. 

But thercvis one aspect of behaviorism that cognitians have not left behind: the 
distinction between amipetcncc (or knowledge, or learning) and performance. 
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PERFORMANCE PROGRAMS 

,With deceptive ease and fluency, Greeno (Chapter 7, this volume) has provided 
us with a feast of performance models for lessons in fractions and geometry. 
Flow charts, or production systems choose the one that is most appropriate for 
Vour theory of a task, and of what happens when that task is taught. For 
cognitive psychologists, this is a powerful and exciting hypothesis-generating 
exercise. For educators in search of a ready-made bridge, it is often dismaying. 
What is the use, they ask, of all this hypothetical formalism? 

There are two answers to that. First, there is no other way of representing a 
complex instructional situation. Believing that it can be represented more simply 
is an illusion. True, we have not yet developed a complete instructional science, 
but we are never going to develop one until we raise our heads from the sands of 
oversimplification. Like the niokvule, the gene, and the galaxy, the human mind 
is very complicated. We will never fully understand it or devise appropriate ways 
of educating it until we have a theory that is detail'ed enough to model it. The 
fact that we have trouble understanding such theories does not alter the fact that 
we need them, and that ^hey represent a proper use of hypothetical formalism. 

Thv second answer to a ''what's the use . . . question concerns the ability of 
human beings to construct response programs (Newell, 1972a). We need com- 
plex models of the type Greeno describes to account for the fact that no two 
people ever respond to the same situation in the same way, as well as for the fact 
that no one can exactly duplicate his own responses. We are endlessly construc- 
tive and inventive. Modeling our capacities in this respect is an extremely 
complicated issue. o 

Consider the subject in Shaw and Wilson's ''orbiting" card experiment. The 
mathematical system described on pages 204^205 represents an abstract logical 
structure. But clearly it does not represent what the subject is doing mentally as he 
performs the experimental task. How might we represent those mental processes? 
The reader is invited to select a modeling schema from Greene's menu and apply it 
to the Shaw and Wilson experiment the p{)int of the exercise being to discover 
that^subjects exposed to the generator set must have built n different representa- 
tion of the stimulus, because they saw different stimuli. Subjects shown the 
nongenerator set^aw hearts, crosses, circles, and squares in only two positions on 
the cards. Subjectjv shown the generator set saw the same stimuli in all four 
positions. To understand the subsequent confusion manifested by subjects shown 
the generator set, we must understand how they represented, or failed to represent, 
the information-compared to subjects in the other condition. Mathematical group 
theory doe.s not predict the construction of differing mental representations. For 
that, we need psychological theories (e.g., HPAM, Simon & Feigenbaum, 1964.; 
Gregg & Simon, 1967). 

In the case of Hyman's experiment, what were the subjects actually doing? 
They were remembering words in a recognition paradigm. How was the proto- 
type-tjie Social Worker or the Lawyer -supposed to be activated during the task 
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itholf? Tins is not speciiied, nor was tlio expernncnl designed [o test such 
specifications- e.i:., tc^ test tlie possibility that a trail lubel which was never seen, 
hut which was venerated entirely by the stereotype, might take longer to 
recogiu/e (si^nilynig a longer secjuence mental operations). In the absence of 
a perJormance theory ol this type, we are compelled to wonder if Hyman^s 
results are not simply another manifestation of a fact reported in I960 by 
Wishner: that trait clusters display intercorrehitions that are independent of 
personalitv CiMistructs. The subject's false recognition of trait nanres may renect 
the associative structure of the language, rather than the psychological structure 
(»fhisnuiul. 

The problem with the peihnmance of subjects in the studies reported by 
Norman, Cientner, and Stevens plagues all the ''netvvtukers.'"''f U)vv do we account 
for the tact that the network was not infinitely activated? Since every concept is 
potoulially iclatod to everv other concept, what preveiUs those reiationslnps 
fiom lirmg'* Somevvheie, in a model of the subject's performance, there must be 
a task objective, rules governing the recruitment of skills and concepts, and tests 
of their aj^plicabilitv and value. 

As a way of t)ri:am/ing llie issues, consider I'ig. 2. 

Any subject, perh)rmmii anv o\|iernnental task, is an "a.ssembler'' of his own 
knowlediAe. orienting skills, mental operations (such as comparing or inferring) 
and seUymanagement tactics. W) respond to a task, he must detect features of 
the silu/ition. or summon feature memories of some kind. \\c will (if he is over 
the age t)l 2 or .>) probably also use words and syntactic rules. He must call up 
welhpracticed motor skills, such as writing or talking. The way he puts all these 
to'jethor his rules ami stiatei:ies for dt)ing so- constitute his performance pro- 
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gram, one which may or may not match up to the experimenter's theory of what 
such a pertbrmance program should entail. 

With reference to the question: why three systems, feature, verbal, and action? 
The answer is simply that we seem to be constructed that way. Our perceptual 
skills, our feature-noticing skills, are not the same as our linguistic skills. We 
cannot substitute percept for word. Nor can we substitute percept or word for 
action and related physiological phenomena. This design for humans has some 
theoretical advantages which may or may not have had evolutionary significance. 

. For example, tlie fact that, a motor skill can run itself off automatically means 
that perception is freed for other monitoring operations. The fact that words are 
separable from percepts can produce discrepancies that are important discrimina- 
tion cues: how else can we learn that all "green leafy vegetables" are not lettuce? 
Bruner (Brtiner, Olver, & Greenfield, 1966) has reviewed much additional evi- 
dence although his own theoretical integration of it has been somewhat differ- 
ent (ram the model shown in Fig. 2. 

In addition to these three systems, we have a stock of speciafprogramming 
operations- problem-solving Iicuristics, classification abilities, operations in the. 

. Piagetian .sense, serializing capacities, and so forth. These are not conscious 
strategies, but are fasti habitual, management routines. 

Figure 2 is esseutinlly a scheme for organizing and comparing complex behav- 
ior, rather than a theory. It is especially useful in the analysis of pedagogical 
situations. For example, consider the "White Sauce Problem" in Chapter 7 by 
Norman, Gentner, and Stevens. What program was the student expected to 
assemble? Answers to questions about French-sauces.. What sort of language was 
involved? Labels like Bechamel, Veloute, mi/x, as well as familiar words like 
saujce, white, aiid milk. What features-actual perceptual experiences-were in- 
volved? None, in this lesson. (That was, Allen Would no doubt have suggested, 
one of the problems.) Similarly, the invt)lvement of the motor system-^stirring, 
disintegrating lumps, gradual pouring- was missing from the lesson. Although the 
authors found the lutee's verbal confusions theoretically interesting, one won- 

\ders if they represented anything more 'significant than the fact that.diffefences 
in consistency. Coloring, and Havoring among members' of the French sauce 
family were not discriminated, because the. necessary nonverbal cues were never 
experienced. 



Overall then, what do we know that would really have been new to Allen? Our 
best theori/ing right now- and it is very good indeed,, as the chapters in this 
volume reveaf-is with reference to models of competence, of knowledge- 
structures. Because they are dynamic models, they represent the human poten- 
tial for the combination and recombination of ideas, rather that the static 
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architecture of lexicon. But we are still not devoting enough theoretical effort to 
the development of models of performance. Whether we are addressing tasks of 
learning, recalh'ng, recognizing, generalizing, or evaluating -we are not yet ade- 
quately modelirti; what subjects do. Allen was concerned with performance. We 
are nmch better than he was in specifying the characteristics of a well-stocked 
head. But he was still ahead of us in specifying tlie characteristics of learning and 
teaching as active processes. 
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It's the Thought that Counts: 

New Approaches 

to Educational Theory 

^* J. R, Hayes 
Carnegie Mellon University 



The chapters in this section are very closely related. All of them are concerned 
with the application of ideas of cognitive psychology— ideas still in the state of 
rapid development— to the problems of instruction. For example^ all are con- 
cerned, at least in piii-t, with the processes by which new information is stored 
on long-term memory and with the implications of these processes for instruc- 
tion. In pursuing this concern, the authors draw on what is now one of cognitive 
psychology's most active areas, the modeling of semantic memory, Tlie area 
includes work by such authors as Quillian (1969), Schank (1972), Anderson and 
Bower (1973), Kintsch (1972), and, of course, the Norman, Rumelhart, and 
LNR group (1972), represented in this volume by Norman, Centner, and 
Stevens, Further, Greeno makes use of goal structures embodied in a production 
system representation in a manner similar to recent work of Newell and SuTion 
(1972), 

There is necessarily a.s air of tentativeness about much that is said in these 
chapters because tiie authors are attempting to point out new directions ratlier 
than simply giving better specification to the old. 

COGNITIVE OBJECTIVES 

1 find Greeno's proposals especially exciting. He lias taken of the difficult task of 
defining cognitive objectives in education- objectives intended to replace the 
more traditional behavioral objectives. To specify a behavior objective for 
instruction, we state a particular set of behaviors we want the students to be able 
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to perform after instruetion, e.g. ti. solve a speeitied elass of aritlimetie prob- 
lems, or to answer questions about a ehapter in a histury text. To speeify a 
eoi^nitive objeetive, we state a set of ehanges we want the instruction to bring 
about in the students' cognitive processes, e.g. aci[uisiiion of a particular algo- 
rithm for division or the assimilation of a body of historical fact to information 
already in long4erin memory. 

Since Greeno dovsMiot discu.s:s the relative merits of cognitive and behavioral 
objectives at any length, it seems appropriate to do so here. One of the most 
miportant advantages of cognitive obji^ctives is that they tend to focus our 
attention on the underlying cognitive processes to a greater extent than do 
behavioral objoclives. An example frtim my own teaching experience will illus- 
trate the point. 

vSeveral years ago, 1 was involved in the teaching of elementary calculus to a 
group of college students who rated themselves ''poor" in hiathematics ability. 
Some of these students had a peculiar sort V)f difficulty in solving algebra 
problems. In problems where the task was to "expfess X in terms of given a 
set of four or live relations, e.g. R = 7? , X 3, etc., a student might combine 
relatu)ns and draw inferences without apparent pattern. Student performance 
imj)roved considerably when they were taught some elementary "planning pro- 
cedures for Klentifying what relations were useful in a given problem and in what 
order they should he considered. The difference, of course, lay not in the answer 
that the student pioduccd but rather in the processes he used to search for the 
answer. 

1 do not know with any certainty why the students had failed to fearn the 
planning procedure for solving such problems prior to college, but the following 
;iiccounl is at least plausible. For very simple problems involving just two or three 
relations, the trial and;.error procedure may work quite will in the sense that tl?e 
problem requ.res no more than two or three trials l)efore a successful solution is 
achieved. If, in learning algebra, the students solved only short problems, it 
might by very hard for the teacher to, determine whether the students were .using 
Irial-and-crroi oi sonic more eftlcient procedure. It would not be surprising then 
if at least some students never progressed beyond trial and error. Now, il is not 
impossible m principle to deal with this problem using behavioral (Objectives. 
What one wu)uld need to do is to be sure that the students could solve problems 
which resemble in all important aspects the. problems they will eventually be 
reciuired io solve. The difficulty lies in knowing what the important aspects are. 
It is exactly at this point that knowledge of the underlying cognitive processes is 
important and that the superiority of cognitive objectives becomes mo'st appar- 
ent. Without an understanding of the cognitive processes it is often. very difficult 
ti> judge just wliat sort of behavior we ought to require of our students. 

I encountered another example illustrating the same point when 1 wasKloing 
research on the use of visual imagery in elementary mathematics (Hayes, 1973). 
One of my subjects reported that he thought of each of the digits as having a set 
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of points that he. used as ^\^ouiUing points." For example, the digit liad 
three cniiiitni^ points each located at one of the leftward projections of tiie 
digit, .-tiie digit ^^4" had four countnig points also located at well specified 
. positions on the digit, etc. When the subje^'t added a pair of^numbers such as ^'5" 
and ^^7," he wnirld yay ^^F-'ive,'' and then looknig at. each oi the counting points 
on the digit ^-7'^ ui turn, say "six, seven, eight, ..." until at the last counting 
point, he arrived at the answer "twelve." When I asked the subject how he had ^ 
learned liiis nietht)d of adding, he told me that he used to' count^.on the digits 
with his pencil until his teacher forbade Inm to do it. lie then switched to 
performing the same processes with eye fixations. Clearly, the teacher had 
achieved her behavumil objectives but she had failed to have any important 
intluence on tlie underlying cognitive processes. 

The scope of the task that Greeno is tackling is apparent in the set of three 
^^xaniples he useil as illustrations. The first example concerns the understanding 
t)f fractions by- prnnary school students; the second, understanding of psy^iho- 
physics at the college ievelr F'or each example, Greeno provides a model of what 
he believes to be the underlying cognitive processes, drawing as necessary on 
modern analysis of good structures, perceptual processes, and semantic memory. 
The details of these mod.'is, of ctnirsc, may need to' be niodified as more 
knowledge accumulates, but the general direction in which Greeno is heading 
seems just right. 

c 

ASSIMILATION OF NEW INFORMATION " 

As we noted above, all four of tlie authors arc concerned, from various points of 
view, with the assimilation of new information into memory. Shaw and Wilson 
focus on the logical-structure of the information being stored while the others 
focus on the integration of new kiiowlcdge with information already in memory. 

Shaw and Wilson propose an interesting hypothesis for concept learning. As I 
understand it, they propose that a set of instances will be sufficient to allow a 
subject to infer the whole concept if the differences between instances imply a 
set of operators which is a generator set for the whole concept. Actually, Shaw 
and Wilson are not fully explicit about the process by which operators are 
inferred trom instances. I have assumed that differences between instances must 
be important ft)i that pr/)cess. An operator is a generator for the whole concept 
ii', by applying it repeatedly to an instance of the concept, it will generate all of 
the instances of the concept. For example, suppose that the cimcept is the set of 
four W rotatitiiis of a sijuare. The pair of instances 
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is sufficient to allow , the subject to infer the whole concept because the 
difference implies a QO*' rotation operator and this operation is a generator of 
the set-of four rotations. However, the pair of instances 



is not sufficient because the difference between the two instances implies a. 180° 
rotation operator which is not a generator of the set. 

The experimental results wliich Shaw and Wilson report are Consistent with 
their hypothesis, but they do not as yet provide a convincing demonstration of 
its correctness. 

O While Hyman's experimental observations are confined to the area of person 
perception, it is clear that his theorectical focus and that of Norman et al. are 
quite similar. Both are primarily interested in the way in which* a person's 
acquisition of new knowledge i^ ct^ttiditioned by the current structure of his or 
her memory. In particular, both investigators are concerned with the way in 
which new information is assimilated to schemata or organized bodies of 
knowledge in memory. 

Hyman's chapter provides an interesting illustration of the problem of assimi- 
lating information to scientific schemas. His experiment is intelligently designed 
and well carried out. One expects, before reading the results, that it will 
demonstrate the infiuence of schemas in memory. But it doesn't-the experi- 
ment fails. Hyman isn't discouraged, nor do we feel he should be. We believe as 
* he does that if one persists, it will be possible to find many experiments which 
illustrate the point about schemas. This incident, though, reminds us that the 
point is a vague one. It isn't that schemas always infiuence rnemory in measurr 
able ways under specified circumstances-it is only that schemas sometimes 
infiuence memory under circumstances which we cannot as yet specify. Clearly 
we need what Norman, Centner, and Stevens are trying to provide-a good 
" process model for schemas. 

DIRECT TRAINING OF COGNITIVE SKILLS 

fn considering the application of psychology to instruction, it seems most 
natural to thinly about what the teacher or the designer of instructional materials 
should know about the student. However, in this volume, Greeno, Norman, 
Centner, and Stevens, and Resnick have all independently suggested that we 
should consider the importance of what the student knows about his own 
cognitive processes and the extent to which we can change these cognitive 
processes by direct training. Greeno says that knowledge of cognitive processes 
"...probably would constitute useful information for students [p. 158].'* 

ERIC 



212 



i:^. THOUGHT COUNTS ,239 



Norman says, "... if a child knows how to learn, then he can get the knowledge 
by himself . , . " and he asks, "Why do we not attempt to teach some basic 
cognitive skills such as how to organize one's knowledge, how to learn, how to 
solve problems, how to correct errors in understanding [p. 000] 

Resnick savs ; . , it seems likely that ways can be found to make individuals 
more corfscious of the role of environmental cues in problem solving, and to 
teach strategies of feature scanning and analysis [pp. 79~80] Such instructions 
would enhance the likelihood of their noticing cues that prompt effective action. 
Sinlilir ideas are being championed by Papert at the Massachusetts Institute of 
Technology. 

This topic is dear to my own heart, since Steven Rosenberg and I recently 
designed and taught a course which was intended to teac^ problem-solving skills 
to college students. Our objective was to provide a course that would help 
students to increase their problem-solving- skills by direct training. In designing 
the course, we made liberal use of the work of others-notably of Polya (1957) 
and Wickelgren (1974) on the teaching of problem solving and of NeweM and 
Simon (1972) on the analysis of problem-solving skills. 

The students who elected the course were distributed through the four colleges 
the University. There were 6 students from Fine Arts, 12 from engineering, 
12 from science, and 12 from humanities and social science. While this mix 
created difficulty in finding common ground on wluch to discuss some topics, it 
was in. general perceived as beneficial both by us^ as instructors and by the 
students because of ihe diversity of ppints of view which it brought to class 
discussions. 

ThQ course consisted of three sections: a Diagnostic section, lasting about 
three weeks, a Theory-Practice section of eight weeks, and a Transfer section of 
two \yeeks. 

The Diagnostic section was designed to serve two functions. First, it was 
designed to provide* the student with information about ihe current state of liis o 
problem-solving skills. Second, it was designed to teach him procedures for 
examining his own problem-solving processes. In all, five techniques were used to 
accomplish these objectives. First, a self-report form was used to obtain the 
students' own inventory of his strengths and weakness in problem solving. 
Second, a problem-solving test including a very wide variety of problems (logical 
problems, imagery problems, writing problems, etc.) w^s administered and each 
student was given feedback about his own performance as compared together 
students, in the class. Third, each student was required to record time usage data 
over one-week period as a means of assessing work habits. iS^ean values for 
number of hours .spent in study and in various other activities were reported so 
that students could assess their own performance against the group mean. 
Fourth^ students were asked to keep problem-solving diaries in which they 
recorded step by step accounts of their own problem-solving behavior on 
homework assignments for later analysis. Fifth, sc^me of the techniques of 
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pa)tocol analysis wore demonstrated in class and practiced in small group 
sessions. 

The thei)ry practice section consisted of two major activities which ran 
concurrentlv • a series of lectures on the tlKH)ry ot problem solving nnd the"'- 
students* skill improvement project. 

The skill improvement project was the Inost important single aspect of the 
ci)urse. On the basis of infornuuion gained during the diagnostic section, the 
student was expected to identify a skitl that he wanted to improve and to design 
a pri)ject whlcii would improve it. Thus, the student had to devise a way for 
measuring his initial state of skill, generate a plan for improving the skill whieh 
drew on materials discussed in the course, :ind measure his final state of skill. 
Areas chosen included skills in logical, problem solving, time management, chess, 
imagery, memory, and many others. 

A second part of the Theory-Practice section was n teaching experience. We 
felt that l)y teaching a skill that he understood well, the student would be 
required to do a careful analysis of that skill in order to communicate it to 
others. Student feeilback. would provide him with' information about the ade- 
L[uacy of his analysis. In general, we found that the teaching task worked quite 
well as a pedagogical device. StudeiUs reported that they did come to understand 
their own skills better. 

The third part ot" the Theory-Practice section was the cour.se of lectures which 
ran concurrently with the skill improvement project. Here we attempted to 
pi-ovide breadth rather than depth on the theory that the interested student 
could explore any ti-pic of special interest to him in greater depth. 

hot example, the lecture topics ineluded the following: 

1. An overview of problem-solving techniques including trial and error, 
learning, heuristic search, planning^, pattern recognition, and a number of 
other methods. 

2. A discussion of the importance of representnMons in problem solving, 
lihislrations of how changes in representatit»n can turn a difficult problem 
niti) an easy one, and discussion of the procedures for constructing 
representation. 

1 he management of short-term memory including demonstration of the 
constraints imposed on problem solving by the limitations of short-term 
uuMUory, ami the demonstration of techniques for avoiding these limita-^ 
tioiis. 

4. The importance of long-term memory (for example, of factual world 
knowleilge) for problem solving and techniques for storing Information. 

5. The natuie ot rule induction ami some techniques for inducing rules. 

6. The nature and use of hypothetical reasoning. 

7. Techniques for decision making and the limitations of the human as a 
decision makbr. 
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^ 8. .The nature of planning and its importance in problem solving. 
9. PercepPual processes and imagery in tasks such as chess and mental 
arithmetic. 

10. The function of mathematical notation in problem solving. 

, In the final section of, the course, the students were asked to identify, what, if 
anything, they had learned in the course that was applicable to their own area of 
special interest, and to report that learning in form of concrete instances. It was 
here that we hoped that both we and the students, would learn in what respects 
the course was of practical use and in what respects if failed in its objectives. In 
general, the results were quite encouraging, as we will see below. 

EVALUATION OF COURSE EFFECTIVENESS 

To evaluate the effectiveness of a course of this sort. is rather difficult since the 
students were working in a number of diverse directions. Nevertheless, by 
examining the student improvement projects and transfer reports, we can iden- 
tify three general areas in which students report definite unprovements in 
problem-solving skills. 

1. Improvements due to increased awareness of own cognitive processes. 

2. Improvements due to increased diagnostic skills. 

3. Improvements in generalize problem solving skills. 

One of the most influential aspects of increased awareness of own cognitive 
processes appeared to be the distinction between trial and error and other types 
of solution procedure. Four of the students commented independently that the 
distinction had clarified their thinking about problem solving. One, an electrical 
engineer ^aid "... my self improvement project taught me that although it is 
not esthcitically pleasing to* me, trial and error solutions are sometimes more 
efficient. 1 have used this knowledge to more effectively solve problems in my 
fiance and piarketing courses.** Another electrical engineer commented "... 1 
have^ always used hypothetical reasoning to some extenl but never realized 
exactly what it was.*' 

Three of the psychology students applied diagnostic skills they had learned in 
class to the process\)f analf zing case studies. Reading through a case study line 
by line, they recorded their current judgement as to what was important and 
what was not important as they proceded. Then, they read the case study again 
and recorded their importance judgements a second time. They used the differ- 
ence between the first and secoijid judgements as a clue to the determinants of 
their clinical judgements. I 

Improvements in problem solving due to generalized problem-solving skills 
appear in a number of forms. A psychology major used imagery techniques to 
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improve lier abiliiy to menu)ri/.e. Applying lier skill lo the game of ci)ncentra- 
t»on, she became gt)od enough so that her frie-nds refused to play with her. More 
practically she applied the technique to remembering appointments; shopping 
lists. learning the (ireek alphabet. 

Several students reported gains due to improvements in planning and organiza- 
tion. A physics student said, "Working problems in this course has lielpc?d.me to 
work problems in physics, not because tliey are the s;ime types of problems, 
which ih^y are not, but because of the orderly methods 1 have developed as a 
result." A psychology student reported, "The first skill I was able to transfer was 
being able Xo clearly identify the prt)blem. Later the same student said, "In both., 
tasks. 1 set up the problem, pt)inted tuit what it was 1 was gtnng to solve, and 
then in an organized manner hniml ml the details that were essential to solve 
the problem/' A niatli student reported, "Outside of math, 1 found planning 
good m writing paj)eis for a histtiry class. It was the first time 1 had ever been 
able to successfully use an t)utline to write a paper," 

A cheniislry siudent reported, "There were other ways of.improving my labs 
through Inno management. iH)r example, there was one U.V. spectrophotom.eter 
available for the third experiment and everyone had lo use Jit. By doing the third 
experiment first. 1 was the t)nly tine on the machine and didn't have to wait in 
line/' " . . , In this way, 1 finished up^ my set o\' experiments a week and a half 
ahead of everyone else/' 

Six students reported applications of knowledge abt)Ut perceptual processes 
ami imagery. A music majtir analyzed the structure of musical notation in 
relation to pattern recognition processes in rcadijig music. A physics major 
improved his ability tti visualize complex molecules in biochemistry. Several 
electrical engineers noted the ckise atyilbgy between the recognition of patterns 
m chess and the recognititin of patterns in analysis of circuit diagrams. 

Three student.s reported that they had used decision making procedures 
disci::vsed in class in practical applicatit)n- tine to clK)Ose an apartment, one to 
choose a graduate school, and one lo i-tlcntify the winner in a Miss America 
conlesi. 

While results such as these are complex and incomplete, and probably contami- 
nated by the fact that students often like h) say eiictiuraging things to their 
teachers, we are, nonetheless, enctiuraged that our course really did help the 
nKijonty of mir students botli by increasing their knowledge of their problem 
solvmg-processes and by providing them with new problem solving skills. ' 

In summary, the major themes in the chapters we have reviewed- 
establishment of cognitive objectives for instruction-direct training in cognitive" 
skills- study of the assimilatitm of information to memory schemes-constitute 
important directions for the intciaction of cognitive psychology with instruc- 
tion. Clearly it will be many yeais before the details are.worked out. Wiien they 
are. liowever, both cognitive psychology and the science of instruction will be. 
richer for it. 
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FUNDAMENTAL PROCESSES 
IN COMPREHENDING 
AND UNDERSTANDING 
INSTRUCTIONS 




I must confess that a man. is giiilty of 
unpardonable arrogance wIU) concludes, be- 
cause an argument has escaped his own in- 
veUigation, that therefore it does not really 
exist. I must also confess that, though all 
the learned, for several ages, should have 
employed themselves in fruitless search 
upon any subject, it may Still, pijrhaps, be 
rash to conclude positively that the subject 
must therefore pass' all human comprehen- 
sion. Even though we examine all the-, 
sources of our knowledge and conclude 
them unfit for such a subject, there may still 
remain a suspicion that the enumeration is 
nut tompletc or tlu' examination not aceu- 
ralo [Hume, 1748/1955|. 
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Verbal Comprehension 
in Instructional Situations 
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Patricia A. Carpenter 
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The main medium l\)r the acquisition of knowledge is probably verbal compre- 
hension. The central importance of comprehension skill is recognized by our 
educational institutions, and therefore comprehension is often used as a criterion 
skill for measuring achievement and aptitude. \n this chapter, we will report on 
our investigation of one aspect of verbal comprehension, namely, the mental 
processes that underlie sentence comprehension. Our research focuses on the 
information a person extracts frt)m a sentence, on the internal representation of 
that information, and on the mental operations that are applied to the 
representation. Our aim is to specify the parameters of the information- 
processing system in simple comprehension tasks. We will validate our theoreti- 
cal proposals by accounting for response latencies in a task where people decide 
wl^ther a sentence is true or false. Then we will examine verbal comprehension 
in a number of other task^, showing how the same fundamental processes are 
common to these various situations. 

This chapter consists of three sections. First, we will outline an information- 
processing model that account^ for response latencies in verifying simple and 
embedded ainrmadve and negative .sentences in which the r^egative sentences 
contain the explicit negative, not. Second, we will show that the same model 
explains how people interpret simple instructions that contain implicitly nega- 
tive lexical iteins like except, different, and forget. Third, we will examine two 
task.s that occur ineducational tesfs of verbal comprehension-sentence comple- 
tion and reading comprehension m order to show how performance in these 
tasks can be analyzed within the same theoretical framework. 
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AN INFORMATION. PROCESSING MODEL 
OF SENTENCE VERIFICATION 

The lntt;rnal Represontatiori 

l»ndorstaiKliiig a sciUciice involve^ inlcrnully representing', the irUDrnuilion that 
the sentence conlanis. it is likely that the lormat oi the niternai representation is 
proposilional, a relational structure consisting of a predicate anil one or more 
arguments. We will use the conventional notation, {PREDICATE, ARGUMENT). 
to denote a proposition. In this notation part of the representation of a simple 
declarative sentence like The dots arc ml is (RED, DOTS), meaning redness is. 
predicated ot* the dots. St"CO predications can be alTirmed or negated, the entire 
representation ot this aflirmative sentence is (AFE, (RED, D07\S)). A negative 
senliMicc like The thus aren't red is represented as (NEC, (RED, DOTS)). AFF 
aiul \E(f are embedihng markers that denote the affirmative or negative 
polarity of the predication. This form of representation allows us to combine 
^ * snnple proposition, to ropreseiM more complex sentences. For example, /r /s 
fortunate that the dots are red can he represented dslEORTl^NATE, P). whore P 
^ IS the simple pro[)osition {AFF, [RED, DCTPS)). 

[ he internal lepresentation of a sentence is ngt necessarily linguistic in nature. 
The verbal symbols in these representations, for example, DOTS, are used to 
denote more ahstfact entities. In fact, research on sentence-picture verification 
suggests that there may be a level of representation that is neither linguistic nor 
pictorial 111 nature J)Ut can represent information from either domain fChase & 
(Mark, 1*)72, Clark <S: Chase, 1^)72). For example a picture of red dots may be 
represented (/^/ A W;/:V). 

I he detailed lorm the representation of various kinds of sentences has not 
yet been empirically verifietl. For example, the research on the linguistic factors 
that determine the psychological predicate-argument structure has only begun 
(cL Halliday, 1^)()7; Hornby, 1^)72). Morcover/there are cases where various 
repiosentatioiis aie loimally etiuivalent aiul the selection of one particular form 
is really aihitrary. Nevei tlieless, this conventional notation is sufficient for iUc 
current model and promises to be tlexible enough to accommodate a variety of 
linguistic structures (cf. Kintsch. 1^^72). 

I he same sentence may be represented tlil fcrently in different situations. This 
follows fiom the assumption that the lepicsentation contains the information 
that a person extracts Irom a sentence. What information is extracted depends 
on the precediiK' svntences. the situation in which the sentence is embedded, and 
the hsteiH'i'^ [uevions knowledge. The role that context plays in how a sentence 
IS represented sm!ge*sis an important distinction between the psychological 
notion of an mternal representation and the traditional linguistic notion of deep 
structure. 
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The Task '\ 

Wc have recently proposed a model to account for the mental processes under- 
lying the verification of affirmative and negative sentences (Carpenter & Just, 
1975). The situation that originally gave rise to Ihe^model is a simple task in 
wliich a person must decide whether a sentence is true or false of a picture. For 
example. Just and Carpenter (1971) presented sentences like The dots are red or 
Ttie dots aren't red, as well as pictures of red dots or of black dots. Thus, the ' 
sentences could be affirmative or negative, and true or false. A person was first 
shown the picture, and then timed as he or she read iht sentence and decided 
whether it was true or false. The results of this .study showed that it took longer 
to verify negative sentences than affirmative sentences by. a certain amount of 
time, called negation time. In this particular study, the negation time was a little 
more than two-fifths of a second. The study also showed that affirmative 
sentences were verified faster when they were true. than when they were false, 
while negative sentences were verified faster when they were false. The differ- 
ence in verification time between the true and false sentence was opposite in sign 
but equal in magnitude for affirmative and negative sentences. This time, called 
falsification time, was a li^Je more than one fiftli of a second in this study. 
These two results, the latency advantage of affirmative^'sentcnces, as well as the 
interaction between affirmative-mcgativc and true-false, 'were also found in a 
number of previous studies (Chase & Clark, 1972; Clark & Chase, i972;Gough, 
1965, 19/)0; McMuhon, 1 963; Trabasso, Rollins. & Shaughnessy, 197I;Wason& 
Jones, 1963). 

The Mental Operations 

In this section we will outline a model that accurately predicts the verification 
times for these simple affirmative and negative sentences. We will show that it 
also accounts lor the verification of embedded sentences. Moreover, the main 
features of the model will serve as a basis for our examination of coiiiprchcnsion 
processes in instructional situations. 

The. main focus of the model is on the operations that compare the sentence 
and picture representations. The model postulates that the corresponding- con- 
stituents (ram the two representations are retrieved and compared, pair by pair. 
Moreover, the number of these retrieve and compare operations is assumed to be 
the primary determinant of the pattern of verification times. Figure 1 shows a 
flow chart for the proposed process. The propositional structure of the represen- 
tations provides an ordering relation on the constituents. Tliis ordering deter- 
mines the sequence in which constituents are compared. Inner propositions arc 
compared before polarity markers. An /IZ-T^ marker in a sentence representation 
is, assumed to match the absence of a marker in the picture representation, since 
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Set Response Index to True 
Represent Sente'nce 
Represent Picture 



Set the Constituent 
Counter, n = I 




FIG, 1 A How chart of the constituent comparison model. 



pictures are generally encoded arfirmativcly. The ''find and compare" process is 
a serial, iterative operation that can be apphed to representations with multiple 
embeddings. This iterative operation will allow the model to be generalized 
without additional assumptions. 

The central assumption is that whenever two corresponding constituents from 
the sentence and picture representations mismatch, then the entire comparison 
process is reinitiated. To prevent the process from looping forever on mismatch- 
ing constituents, we assume that the first time a mismatch is discovered, the two 
constituents involved are tagged, so that on subsequent recomparisons the two 
will bejreated as a match. 

Since mismatches cause the comparison process to be reinitiated, the total 
number of comparison operations, and consequently the total latency, increases 
with the number of mismatches. Moreover, a mismatch that occurs later in the 
comparison process results in more recomparisons than a mismatch on earlier 
constituents. Thus, the total latency is a function of both the number of 
mismatches and their locus in their respective representations. 

A response index records the matches and mismatches between constituents. 
The index has two possible states, tnie and false. At the beginning of each trial, 
its -nitial slate is true, and each mismatch causes it to change its state. The time 
spent in changing the response index (and tagging mismatching constituents) is 
assumed to be negligible relative to the time to perform the find and compare 
operation. 
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TABLE 1 

Representations and Predictions for the 
Four Information Conditions'^ . 





True affirmative 


i-aise affirnitUivc 


Sentence! 


1 lie UUl^ ICvlt 




Picture I 




DiaLlv UU L5 


Sentence represcntutioni 




^APP /'RPn nnTQ'i 


Picture representations 




VDlrfAVV^iV, \J\J 1 0^ 






— index ~ false 










k. f'(itTltTiri?(^nQ 








/c + 1 comparisons 




False Negative 


True Negative 


Sentence; 


Hie dots aren't red. 


Tlie dots aren't red. 


Picture: 


Red dots 


Black dots 


Sentence representation: 


{Nl':G,(R[a),OOTS) ) 


(NEG, (RED, DOTS)) 


Picture representation: 


(RI D, DOTS) 


(BLACK, DOTS) 




- + index ~ false 


- index = false 




+ + 


" + index = true 




response - false 






k 1 comparisons 


response - true 



'^Phis and minus signs denote matches and mismatches of tlie corresponding 
constituents, l ach horizontal line of plus and minus signs indicates a reinitia- 
tion of the comparison proeess. 



When the model Is applied to the proposed sentence and picture represen- 
tations in the Just and Carpenter experiment, it can account for the latencies in 
the four, conditions. In the simplest case, the true affirmative, there are no 
mismatches between the sentence and picture representations, as shown in Table 
I. The first comparison, between the inner propositions, results in a match. The 
second comparison, between polarity markers, also results in a match (Rfcall 
that AFF marker in the sentence representation is presumed to match the 
absence of any polarity marker in the picture representation). Thus after 1 total 
of two a>nstiluont comparisons, the truth index is still set to true, / nd this 
response is. executed. The number of constituent comparisons in the true 
affirmative case serves as the base line for the other conditions, ard will be 
referred to aS k. Here, k equals 2. 

In the fajsc affirmative ct)ndition, the inner propi)sitions of the sentence and 
^picture mismatcfi. The mismatch will reinitiate the comparison, process, causing 
one extra comparison above the base number. Table 2 shows the consequences 
of this mismatch in detail. The mismatching constituents arc tagged and the 
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TABLE 2 



A Trace of the Operdtlons In Verifying a False Affirmative 



Stimulus sentence: The dots arc red. 
Stimulus picture: A sci of black dots 



Operations 



lnitia!i^c response inde\ to true 



Represent sentence 



(AM . (RFD, DOTS) ) 



Represent pictuic 



IHI.ACK:, DOTS) 



I. Compare first constituents 

Tag sentence constituent 
Taj:» picture constituent 
( hani'e uutex to false 
Reinitialize comparison proce'^*? 



(ATT-, ( M ) ) 
( M ) 



2. Compare first constituents 



3.( '*>niparo secDUil tunstituetUs 



+ 



Nuinlier of comjiansons 



Respond with conti'itt mtic\ 



h'alse 

k + I, where k^ l 



response index us set [o false. After the reinitiutitin, the tugged inner constituents 
are compared, and they match. The next eomparison, between the polarity 
markers, also results in a match. So/the resptmse false is executed after a total of 
k + I constituent comparistins. 

In the false negative condition, there will be a total of A' + 2 comparisons, due 
to the mismatch on the sec<ind constituent, the polarity markers. This mismatch 
will cause the response false to he executed. For the true negative condition, 
bi)th the first and the second constituents mismatch, so that the response true 
will be executed after a total of A' + 3 ctmstituent comparisons. Both of these 
cases arc summarized in the bottom half of Table I. 

The model postulates (hat ven Ilea lion latencies should be a direct function of 
the number of constituent comparisons. The number of comparisons, and hence 
the latency, should increase linearly from true affirmative (A), to false affirma- 
tives {k I- 1 ), to false negatives {k + 2), to true negatives {k + 3). 

The results of the experiment, as well as the best Htting straight line, arc 
shown in Fig. 2. The predictions of the nuidel fit the data quite well. The model 
accounts for ^^HXYr of the variance among the four means. The slope is 215 msec 
per constituent comparison. 

Only one parameter, the tin;e to find ami ctnnpare a pair of constituents, is 
necessary to characterize the processing in these four conditions. Elsewhere 
(Carpenter & Just, 1975), we have tested the detailed predictions of the model 
and shown that it can also account for the latencies in many other similar 
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|S!ope =215 msec/Comparison 



18001- 




- i. - .1. L - X J 

K K+1 Kt-a K + 3 
(TA) (FA) (FN) (TN) 



NUMBFR or CONSTITUENT COMPARISONS 



FIG. 2 The tit tit ttic toniitituont comparison model tor tlio four information conditions. 
(Data'trom Just & Carpenter. 1971, H\p, 11). 

experiments (i.e., Clark & Chase, l-xpts. I, li, & III, 1972: (u)ugh, 1965, 1966, 
Expt. II: McMahon, 1963, Trahassti at ai, t-xpt, IX, 1971). Tlui.s, the current 
model provides a parsimonious explanation of performance in these tasks. 
Althouj^h parsimony is desirable, the model should be evaluated on the basis of 
its ability to offer a rigortnis formulation that is both a plausible mental process 
and can incorporate a wide variety of empirical results, this ability will be 
demonstrated in each of the tollowing sections. The nature of the propositional 
representation, particularly the embedding feature, should allow the model to be 
generalized to more complex sentences witlumt additional modifications. This 
property of the model was tested by examining embedded affirmative and 
negative sentences. 



A Test of the Model 

To further test the model, the scope of the negative was systematically varied. 
Other factors, like the scntenee length and the picture, were kept constant. The 
scope of a negative is defined as the range of constituents to whicli it applies 
(JackendolL 1969, Klima, 1904). The affirmative sentences used in the experi- 
ment included the superordinate clause It is true that . . . (c.g!. It is true that the 
dots arc red) and ctnild be negated in two ways. With one type of negation, the 
negative has a small seo[)e, namely the inner prediea.tion: It is true that the dots 
aren't red. This will be called predicate negation. The second type of negation 
has a larger scope since the negative is in the .superordinate clause where it 
applies to the entire inner proposition: It isn't true that the dots are red. This 
type of negation will be called denial. Denials should take longer to process than 
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predicate iiegntives because the nusinatch will occur on a constituent that is 
coiTioared later. The exact predictions can be derived by examining the hypothe- 
sized representations lui these sentence types and their interaction with the 
cornpanson process. 

The represei\tution of an atTirnuuive sentence like //Iv true that the dots are 
red may be the same as lor the simple sentence The dots are red, namely, MFF. 
{RID, DOTS)). The rationale is that th'e embedding clause It's true . . . does not 
change the truth value and so it can be ignored. To demonstrate this point, 
consider a concatenation of this type of clause, e.g.. It*s true that it*s true that 
it *s true . . . the docs are red. The number of such embedding clauses is irrelevant 
to the truth value of the proposition. Similarly, the embedding affirmative 
proposition may be deleted from the representation of a predicate negative 
sentence like It\ true that the dots aren't red, so that the representation would 
he {Md, iRi-D. DOTS)). However, the representation of a denial like /M5^Y 
true that the dots are red, nnist include the negative embedded clause. Here the 
embedding clause dt)es affect the truth value of the sentence. Thus, denial 
sentences might be represented like {NI:G, {AFF, (RhD, DOTS))). TUo pkiurcs 
would be represented as simiile propositions like (RFD, DOTS) or (BLACK, 
DOTS), Table 3 shows examples of the representations, in the six conditions. 

llie experiment was verification task in which the person was. timed while he 
read a seirterrce. looked at a picture, and then decided whether the sentence was 
true or false of the picture. There were 24 subjects. 

Ihe predicitions iif the model can be derived by examining the How chart 
model in I*ig. I and the representations in Table 3. The predicted number of 
operatruns necessary to verify a true aftlrmative is Av for a false affiriTiativc it is A: 
t 1 ; for a false predicate negative it is /: + 2: for a true predicate negative it is A: + 
3: for a false denial it is A + 4: and for a true denial it is /: + 5, The veriilcation 
latencies should increase linearly with the proposed number of operations. A 
linear increase in latencies among these six conditions will ci?nstitute strong 
support for the constituent comparison model and the notion of a single 
underlyini' itfialive operation. 

Ihe results showed that, as predicted, the mean latencies increased linearly 
with the number of hypothesized constituent comparisons. More precisely, 
latencies nicrcascd an average of 200 msec for each additional constituent 
cnmparispn (Standard l-rror ^ 23 msec). Figure 3 shows this result, along with 
the best tittini^ strar^hl line. The mc)del accounts for 97. of the variance 
among the six means. FiW 1 1 5 ) 1 7 j .1 7, /; > .01. The residual 2.37^ is not 
siiMiifieant, /'H, 1 1>) = 1^01. The root mean si|uared deviation (RMSD) of 52 
msec is small relative in (he 200 msec parameter. This analysis confirms the 
major iiypothesis that verification time nicteases linearly witli the number of 
constituent comparisons. 

The error rates lor the six conditions weie correlated with (he latencies (r = 
.98), as is shown in FMg. 3. This correlation hidicates that the probability of error 
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TABLE 3 

Representutions ond fVtMiictions for the Six Information Conditions'* 





True affirmative 


F'llse affirmative 


Sentence. 


It's true tliat the dots are red. 


It's true that the dots are red. 


Picture: 


Red dots 


Black dots 


Sentence representation: 


(AI I\(Ria), DOTS)) 


(AI'F, (RFD, DOTS) ) 


Picture representation: 


(RI'I), DDIS) 


(BLACK, DOTS) 




+ + 


- index = fiilse 




response - true 


+ + 






response = false 




V 


k + I comparisons 


■-- - 


I'alse predicate negative 


True predicate negative 


Sentence; 


It's true that the dots aren't red. 


' It's true that the dots aren't red. 


Picture: 


Red dots 


Black dots 


Sentence representation: 


(Ni:(;,(Ria), dots) ) 


(NEG, (red; DOTS) ) 


Picture representation: ,^ 


(RFD, DOTS) 


(BLACK, DOTS) 




+ index false 


~ index = false 




+ + 


- + index = true 




response ~ false 


+ + 




k + 2 {n)m pari son 








n. ~ LviiipuXisons 


^ 


I'alse denial 




Sentence: 


It isn't true that the dots are red. 


It isn't true tliat the dots are red. 


Picture; 


Red dots 


Black dots 


Sentence representation: 


(NK;, (AFF, (RED, DOTS) ) ) 


(NEG, (AFF, (RED, DOTS) ) . 


Picture representation: 


(RFD, DOTS) 


(BLACK, DOTS) 




+ + index ^ false 


- index = false 




+ + + 


+ + index = true 




response - false 


+ + + 




k + 4 comparisons 


response =f.jtrue 






k + 5 comparisons 



^Plus and minus signs denote matches and mismatches of tlie corresponding constituents^ Each 
horizontal line of plus and minus signs indicates a reinitiation of the comparison process. 
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rjUMB'FR OF CONSTITUENT COMPARISONS 
FIG. 3 The tit o\ the consiitiient coniparison model for the six intbrmution conditions, 

increases with the number of hypothesized operations. Jhis suggests that the 
probabihties ol crrcu in the comparisons are additive. 

The model is able td predict the processing time tor these six conditions on the 
basis of a single parameter: the time to find and compare a pair of constituents. 
These results strongly support the hypothesis liiat a single iterative operation 
accounts for the processing of affirmative tind negative sentences. The embedded 
representation, combined with the iterative comparison operation, allow the 
model to account for tlie two scopes of negation without additional assump- 
tions, ' 

A turther control st "ly showed that the representation and processing of the 
sentence is determined by its semantics, rather than by its surface structure. To 
sliow this, we ccmipared the processing of sentences that had the same con- 
stituent structure but different surface structures. In this control study, l^ie 
inner prc^positions of the sentences. were embedded in two ways: the same way 
as the previous experiment (e.g., ft's true that the dots aren't red) and with the 
embedding clause at the end (^f the sentence (e.g., Viat the dots aren't red is 
true). Both of these kinds of sentences are postulated to have the same con- 
stituent structure. However, the position of the negative in the surface structure^ 
has been changed. If the results of the basic experiment can be replicated with 
the new sentences, then the results uinnot be due to position of the negative 
morpheme in the surface structure. The new stimulus sentences were: Affirma- 
tive That the dots are red is true; Predicate negative- That the dots aren 't red is 
true: and Denial That the dots are red isn't true. 



SENTENCE AND PICTURE 
SIMULTANEOUS 

Slope = 200Msec/Compari5on 
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This control study showed the two types of surface structures were processed 
similarly. Both types of sentences showed a linear increase in latency as. the 
nurnher of comparisons increased. Regardless of whether the negative morpheme 
occurred near the beginning or end of the sentence, denials took about 500 msec 
longer to verify than predicate negatives. This result shows that the underlying 
constituen't structure rather than order of negatives in the surface structure 
determines processing time, and constitutes further support for the prtiposed 
representations for the two kinds of negative sentences. . 

The mental processes described by this model are not specific to the senteiice- 
verification paradigm, but occur in a large, number of situationji that involve 
verbal comprehension, Tiiesii-more general processes involve relating the infor- 
mation from a sentence to information from a second source, such as the 
listener's previous knowledge of the world. For example, in order to agree or 
disagree with a statement, it is necessary to compare the statement to a 
repp:seiHation ot one\ own belief. In order to answer a Wli question (e.g., Who 
pointed the fence informaticm provided in the qv^estion (e.g., that someone 
painted the fence) mu^t ()C compared to previous knowledge before the interro- 
gated ctmstituent can be retrieved. In order to acquire new information through a ~ 
•verbal medium, the old information in the communication will serve as a basis to 
which the new inl\)rmalion is added. I'he determination of which information is 
old can tinly be made if the sentence representation is qompared to previt)us 
knowledge, In the next section of this chapter; we will show that these compari- 
son tiperations alst) occur when we follow simple instruction. Thus, the basic 
kintls o\ operations described by the model are part of a large class of compari- 
son operations that occur very commonly when we comprehend linguistic 
material, , 

The mental operations described by the model are not specific to the process- 
mg of explicitly negative sentences, but rather they occur in the processing of a 
variety of semantic structures. , Elsewhere, wc have shown how the model 
accounts for semantic structures such as negative quantifiers like few, particular 
and universal cjuantifiers like S(fnie and all (just, Pn4), counterfactual clauses 
like Mary would have left . . .(Carpenter, 1^)73), and active and passive sen- 
tences Jike Tlie car hit the truck and The truck was hit by the car (cf. Carpenter 
& Just, 1^)75). Next we will show how the model also accounts for the 
pruccssuH^. ()} instructinns that contain implicitly negative-predicates. 

COMPREHENDING IMPLICITLY NEGATIVE INSTRUCTIONS 

A number of predicates like yf)/;tfr7. th(>u,i!:htlcs!i, disui^^ree, nwd absent ixc consid- 
ered implicitly negative (cf. Clark, in press: Just & Carpenter, 1971; Klima, 
1964). For example, we may define forgot didn't remember or we may think 
of absent lis not present, and so on. By contrast, we do not generally think of 
remembered iis didn't forget. This suggests that there may'-be an asymmetry in 
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how we internally repr^^sont pairs of lexical items Wkc remember ixnd forget; tin 
implicitly negative item Wkc forget may be internally represented as a negation 
of remember. This hypothesis can be tested by examiag the data from a number 
of conipreheiision studies that have used such implicitly negative predicates. 
Two types of studies provide relevant data. The first type involves sentence 
verification tasks where the stiniuh contaiiied implicitly negative predicates. In 
the second type of study, the implicit negatives were in the instructions given to 
tlie subject. If predicates like forget are represented as negatives, then their 
processing should conform to ihe constituent comparison model. 

Remennber- Forget 

The implicitly negative predicate forget to presents an interesting opportunity 
for examining the comprehension of negatit)n. Not only is this predicate nega- 
tive, hut the.. [)roposition embedded in it is also negative. For example, the 
sentence John forgot to let the dog out directly implies that John did not let the 
dog put {Kartturien, 1971 ). Thus one can study how people extract information 
from the implications of implicitly negative predicates. In a study by Just and 
Clark (1973, Hxpt. U), subjects were .presented with an affirmative sentence 
{John remembered to let the dog out) or an implicitly negative one {John forgot 
to let the dog out) and then were timed as they' verified the probe sentence (e.g., 
The dog is in) us true tir false of the implication of the parent sentence. The 
relevant informatiim from a sentence like John forgot to Jet the dog out is that 
the dog is not out. This may have been represented as (NI:G, {OUT, DOC) ). The 
information from a sentence with reme^-^bered to would be represented as {AFF, 
{OUT, DOG) ). This sentence representation would be compared to a representa- 
tion of the probe, like The dog is in,, represented {AFF, {IN, DOG) ). The model 
predicts that verification latencies should increase linearly from true- 
remembered, to {^ixhc -remembered, to h\^Q -forgot, to ixue-forgot. The data 
confium very nicely to predictions of the rntuler, which accounts for 94.6% of 
the variance among the four condition,s, as shown in Table 4, This result shows 
that the implications in implicit negatives are processed similarly to explicitly 
negative sentences, 

Prfisont At)sont - o 

A similar kind of v.erification task pnwides evidence that in'dicates absent is 
internally represented as a negation o( present. Sentences like The star is present 
nr The star is absent were verified against pictures that eitiier contained a star (*) 
or a plus (■^), Clark (in press), W absent is Interiuilly represented as a negative, 
therr. a sentence like Tlw star is absent rTiiglit be represented as (NFG, 
(PRFSF\T, STAR)). This representation would be compared to the representa- 
tion of the picture, aihcr fPRFSJ'm) STAR) (n (PRESENT, PLUS), in this 
experiment. These representations can be used to generate the predictions of the 
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ni »J.^h liti' iateiicics ^hnuKi Jicre.isc litUMrlv linni Hue present, to kilso 
pre^^ fjf. jhsent, t-Miuc absent. An Table 4 s|itnvs. lluMiiodol accounts 

i^r 'M s oj rh>' % in.Mue aniontr the tour moans, with an ostiniatod U)^) msec 
|)t r c"u-,r!tii vompaiiMi'i^ 1 Inw. iho u' uii . suppoi! tjio hyptUhosis tluU tti this 
ta%k/.//'Vt/// iMtciprctctI as an iiiiphvil ri^iMtivv M^icovcr, the ciiuiiUitative 
fc*;,iti»uu ani'iiiii t\w Imiu l itoiu ie> aippoit tiio kKm tliat Ihcic In a sctial rotricvnl 
.ivd compans^'i? i^t coi ^i uncut ^ tnun the iiuonial rcpicsciitatioiis ol the sentence 
Mid pk tmc 

Ih'j lu^xt vevcial experiments are tasks in which the instructions coiuained 
ijnn*!CU neiMtive-. Wo will s\h)\K that the comparison process ptistuhited by the 
lu^'d-^i seiiJcncv" venticatiun also e\[ilaiiis how people niuler>»taiul and execute 

•■.iHif^Iv' l^sl^nc^^'^s. 

Sarin* i)}ff»'r»'nt 

Onj e\[)enment that used negative instructions involved comparing a word 
( ifh;'! the wortl ( in h' oi stpuire] to a picture (of either a circle or a square) 
CS;'\nio!n, I'K^^h On" «Moup oi suhieels was i»iven an anirmative iristructioh; 
th.'V were asked to respond "yes" \\ the word and the picture had the same 
iiivMmni* and to nspoml "rjo" {Otherwise. Anotliei i^ioup of viibjocls was ^iven a 
rh*.'ative nistruclion respond *'\es" \\ the word ami picture are ditTererit, and 
othefWisc. liu' iiistruction invoKnM:^ the predicate may have been 

repje^eiited w ith a ueiiative: respond 'Aes*' if the picture is not the samouas the 
word f //.V. V.'A where the svmhol X takes the value denoted by the word. 
I .'Xample, when the wor^l wasc/zrA;, it woijld be coded uito the iristruction 
as . Md //^. ClRd.l^K I hen, tins representation would be compared to the 
picture re[uesentalion. It the picture wa> a stjuare, the comparison between the 
teprv^seniation of the nisfriiction arul the representation oi" the picture, (IS, 
^or. iRl-K would result in a "yes" response, if the instruction were compared 
t-j :i picture itT a ciicle. the ct'rmpanson Wiiuki result in a ''no" response, l-ach 
un\^ an ni arnction wi(h ihfferent is executed, the subject is essentially process- 
n '-» 1 !iei!a(ive ^onsUMction. I heielore, the model pretHcls that latencies should 
}r^cre,ise liiiearlv trom "\es*' sdnh\ to ''no'* same, to "''no'' -different, to 
•'\eN" ilitterent. As Table 4 shows, the rnotk^l accounts for 98.8'/; of the 
't irnrut' aiUiUie the (oui means, with a slope ot' 82 msec per constituent 
^ "}!Jparison. IIiin supports the hyiiothesis^ the t//77c*Av// is internally represented 
a. ati nnphcit iK^eative. Moreover, the results show that the mental processes 
ir!\*4vetl in tAecutini: uist ructions can he explained b\ the model tor sentence 

VM^lKatlofL 

Agr^w Corifhct 

A verv smnkir experiment by Trabasso rr ^;/. (I xpl. X, 1^71 ) can be analyzed to 
Ksf wlu'thei tlic predicate t^'nfliet is internallv represented as a negative. The 
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task was to compare a word (either nnux'^c oi tfrcc/n lo a picture that was 
culoro'.I eith^T Miaiuje ui vucon. One ♦Jiroiip o| suhiocts was iiivcn an attiimativc 
iiistiiicrion pidsv whoflior nr luit the word and the picture atJireo. Another group 
was i»iven an inif^ii.ifU noivitiv- uiMruction: iiidtv whether or not the word and 
picture ctnillkt \\w m^inwunw uivolvuhj o^nflict might be represented as 
(Siii fIS, V//. wheii* the svuiIhiI V would take the vahie of the cohir word 
presented dunng the tiiai. 1 oi e\am[ile, suppose 'the word orange were pre- 
sented; It would he coded jnlt» the mstructu^n us fXFd, (IS, ORA.Xdi:}! 
then compared fo the picture If the picture were colored green, the comparison 
between (he repie^entation ihc instruction and the representation of the 
picture.. <AV. d'Rll \\ WtniM uv>uif ui a response of "\es." if the instruction 
were Ctuiipared to an orauLV |ncture. jt would lesuli ui a response ot **no." These 
represent:itt;iii'> lead (o tfic prediction that the latencies should increase linearly 
Irom ''vcs^ ./ifA'-. N« "no" in^nv, to •^m" anijlict, to "yes" (v;/i//zVA As 
lal>ie I diow.. ffj> ni»»Jel a^. counts for ti! the variance among the four 

niearis, with an i-^iirh i! .* of !t)0 ni>ec per constituent comparison. This supports 
the lupothesN i!iaf !h - phKv.v. involved in lollovving simple instructions with 
ui'rtr afid (onflut aic rhe >pffa(iofi, o( tepresi-nting. letrievmg. and comparing 
con -ftrui ni *. 

Synorryniuus Uf)r^»^^lr^Hi 

The 1 exKal item winhiti i mav alsi) he represented as an implicit negative. To 
test this [p.pothe.ts, liavden and (dark asked people to iudge the semantic 
rekitiofi hctwecTJjwo wokU that had the same meaning (e.g.. lavi^c and or 
diftetenf meanmi:s (o.j . Liti^v and m/r )( reported by Clark, m press). One group 
ot snbjoctN was eiven art allirniative instruction: judge whether or not the two 
words are s\nonvrnons. Auotiier iiroup was uivcn an implicitly negative nistruc* 
ti(»n: judee whether or not the two words are unrelated. The instruction with 
inircUtt'd mav have l>L'en leprt'seiUeil like the unplicil neiMlives (///'/rnv/r and 
nmflut i\l If. rUI \\S. \;/\ vvheie V takes on the value of one oi the two 
words present. t|. in a trial, f or example. supp«)se the pair fhivi^c tidy) were 
prescfiteu. Ihe first word miu-hi tv coded uuo "(he nistruction, AVH/, f.\fI:AXS\ 
/.ARdi ii Ihe second word wtnild be coded as ^;U/:.1V.V. 77/) y; and then 
coininied io th;' t;-jM^-,enfa(!o!i of the nistructitin. In this ease, the response 
wiwild W "vcv" If rh' .ec nul word weic the lesponse would have been 
**no/' Ihe m'Hiel predicts rfial' latencies shofdd increase luiearly from "yes''- 
synofivnt^^ns, fo 'Vio" M7;o;/r//v»//\, to **no'^ wmiatcd, to *Ves" unrelated. 
As I able t .hoWs, ihe inotlrl aceiMinf> fot V)0.s ot the variance ami^iu^ the 
means, with an estimate ot W'^ nisei per constttueiil comparison. This supports 
the hypothesis that unrchited is represented and executed as a negative in.struc- 
lion. As in the cases dithrau and conflict, the negative liciu unrelated takes 
longer to execute and causes die *>es" response to take h)iiger than the "no'' 
response. 




Ext>?pr 

In .1 Uitfi't-nt kuu\ i}\ task. Juries ( 1 '-^ht^a, b. \'H^s) oxainincd lunv people 
ow.'Ufv i? •^r[-iut(Mri> rin( x»»THain rfj-* iinpiiv'UK iwvaIwc \\o\<\ twccpt. In these 
tar>ks. pf.*'>p!.' •A^»alil !cad an atlinnatlvv M?slniclion i^ko "Cioss out tlio Clumbers 
I. -V 4, or a iK-'jaiivo instruction like "( rossout all tiie iiuminrrs except 2, 

5. S." Ilicn the\ weie I'lVen a sheet that was tilled with di^iits 1 to 8 in random 
iirilor aiul tuned while thc\ pertMiined 'the task. The two instructions require the 
satne <iVt*rt resporucs; but \( except is a nejialivc. the two instructionii will cause 
vei\ tlitlereru mental v>pi-ratioiis. We hypothcsi/ed that the instruction with 
t'xn'pi is lepresenti'd as f \I (i, fIS, 2 i^r 5 (>rS}j. l .aeh digit cncoiinte ed on the 
paue would be repieseuieJ fIS, A'A where V takes the value of t^c digit. The 
iligjt will be crossed out it there are two mismatches bctw^^eu the iwo representa- 
tiniiv ihis wntdd happen if ,V took the value 7, for exampi \ ily contrast, the 
a!!trmafjve mstructi .ii would be lepreseiUed ^1 /-V'*, (IS, I or or 4 or 6 or 7)). 
l ach dii'it '•nc«>unioreil on the page would be represented as /'AV, AV so the digit.^ 
wiMild be crnssed nut it there were lu^ mismatches. Tlie negative instruction took 
a sigmtlcant 1'^ v?*, lonuer to execute, and resulted"in signitji:antly more false 
pi^sitivc emus (crt)'vsing i>ut digits that weren't supposed to he crossed out). 

In a sec'Nid expeiiment. Jones ccjuated the number of digits to be represented 
m an mslmction. I he positive instruction was "cross out tlie digits 3, 4, 7,8." 
riic negative instruction was to ''cross out all members except 1,2,5, 6.'' Again, 
the negative instruction tvH)k much longer to execute (by 100 sec) and resulted^ 
in more talse pnMtive errors. Thus, executing a negative instruction, even in a 
vor\ ditterent kind nt task, takes significantly longer than executing the equiva- 
lent aflirmitivc <)iie. This is consistent with the hypothesis that mismatches 
between the internal representation of an instruction and the representation of 
Mune seci>nd source ot intonnation, will lead to longer latencies. 

The precednig analysis inakes it clear that certain single words arc internally 
represented by *two ccMuponents an aflirmative core as well- as a negative 
iomi^ouent While we cannot specilv a [iriori whether or not a word is internally 
ro[nov.*rurd as a nviMtive. oui model does provide a procedure to discriminate 
negative lexical items from affirmative items. If the verification latencies for a 
suspect word are shorter for talse than tor true, then we infer that word is being 
rf'pitsented and processed as a neiMtive in that situation. Thus, the results cited 
jbn'vf s'hovv (hat /*/rif(7. <////( re;//, iuircltih\i conflict, and except are represented 
as neiMiivt's I he same kind ot analysis can also exonerate suspect words. For 
ex.imple. sikjII is mU processed .is a negation o\ lari^e; it is represented as an 
altiunatiVf* (( arpenter v!v: Just. I^>"^2: Just ^ Carpenter. HHl ). 

Othr?r !n'itrucrK)nal Exam pi ^^s 

Comprelicnding an instruction can be a major source of dilticulty in perform- 
ing an everyday task. We sometimes encminter complex instructions where 
there i» no tt>nceivable pupose tor their complexity. I'he following notice from 
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the Internal Revenue Service (Form 4918) provides an example (itiilics added): 
ANY QUESTIONS ABOUT THIS NOTICE? 

In the oveiit \vt' /.;//<•(/ to I'jve vou «. re(lit Un .i f edoral tax dopt)sU or any other 

paymont vnu madt*. ploasc accept nur apolou'> ;uui bo ^ludod hy the tolhnving: 

< ■ ■ 

I. n the payment ni>( credited was luaiie williiiil tlie last tour weeks i)r so, we will 
credit it noon You need not write us. hist subtract the payment we haven't included. 
'2. (i the payment not creihleil was made more tiiin tour weeks ago. subtract it tVoni 
the l>alance due . . , \ 

3. It you haw paid rhe entire balance due within tl.ii^' last lour weeks, please disreRard 
this no Ike. 

Please send us an explanation it the Ixilance i\ incorrect tor any reast)ns otiu/ than 
payments we haxcn't credited 

Exptanatton of Penalty or Interest Charges 

Your return wus not Ided and vour tax was not paid by the due date. The combined 
penalty is S percent t>t the lax nttt lirnely paid lor each month of part of a month the 
return was late, but not nuue than 25 pen ent. 

this notu I* IS not the result ot an audit ol your return. When we select a return for 
audit, we notify the taxpayer 

Prosumablv the IRS is mU interested in testing our ct)mprehension skills. 

in other situations, the purpiise of a ctunplex instruction is precisely to assess 
comprehension skills, as illustrated by the following item (Personnel Test, Fonn 
D.J-., r. Wnnderhc. \')21y 

Count each / in this series that is followed by an b next to it if the I- is not followed 
by an S next to it. Teil how many /.\ you count. 

/I /SI Y/i SYl /I I SYS/I I /bSI ZYI Zl Y 
This IS an extremely easy task if one comprehends the instruction, which could 
have been sitnphfied as follows: Onmt the iH vurrcncvs oj the sequence (jZ/, jFj, 
Inon S' } in this series. 

Thef',* are other situations where the purp(Jse f)f complex instructions is not 
clear. The followuig example- is taken from an aptitude test for prospective 
students of management science ((Graduate wStudy in Management: A Ciuide for 
Prospective Students, \')74) 

lUrcctiom 1 ach o{ tlv da»a sulliciemy problems below consists of a question and two 
statements, labeled U) and (1), in which certain data are pven. You have to decide 
whether the data uivon m the statements are sutllcient for iinswering the questions. You 
iirc to blacken spat-C 

A. if sialemenr ( 1) MOM v> stittMenl, but statement {}.) aUme is not sutticient to 
answer tlv: (jfiestion jsked. 

B. It statement (2) \f C^M i^ sntficient, but stifemenl (I) alone is ni>t sufficient to 
answer the question asked; 

r. if BOTH statements f I ) and il) lOCil Tfll R are suftkient to answer Uie question 

asked, but NM IHI R statepicnt A I OW is suiTicient; 
f) If I ACH statement AI ( >N'l is sutticient to answer the qnestitm asked; 
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F. It statements (1) and (2) TOGMHIR are NOI sutllcicnt to answer the question 
,^ asked, iuid additional data specitlu to the problem '*u needed. 

P 

Example: In A PQR, what is the value of.x^ 
(2) y = 40 ' 

Answer C (J • ' ' M< 

This kind of instruction seems to be testing both the ability to comprehend., 
instructions, as well as knowledge of geometry and logic. Incorrect answers 
could be caused by any of these three sources. The relative contribution of 
comprehension difficulties can be assessed by rewriting these instructions in a 
simplified format. 

HmscJ Directions Answer YES ox SO to each of the following questions. 
In PDR, can you deternine the vylue of x if all you know is that: 

( 1 ) PQ ^ PR (Answer is SO) 

(2) v " 40'» ( Answer isAY;) 

(3) PQ - PR am! > 40'' (Answer is YES) 

These examples illustrate how successful performance in a te^t may depend on 
comprehension skills in decoding the instruction, as well as the content skills 
that the test ostensibly taps. Thus, both components may enter into the test 
scores that can often predict future academic performance. 1 1 may turn out that 
the predictive ability of the test is partially due to the comprehension skills it 
taps, rather than the content skills. If the test is being used only for actuarial: 
purposes, the relative loadings of the two factors are irrelevant. However, if the 
testing is Tor ^agnostic purposes, then it it necessary to assess the relative 
contribution nf ctJmpreliension skills before remedial action can be taken (cf. 
Hunt, l^rost. Lunneborg. 1973). This may prove to be a fruitful approach to 
test constructujn. 

In many situations, the primary purpo.se of an instruction is to inform, to help 
people perform CDrreclly and efficiently. I'or example, instructions on income- 
tax h>inis ni in re[)air maruials should be constructed to niinuTil/e comprehen- 
sion difficulties. A theory of sentence comprehension such as we liave outlincd^ 
suggests the kinds of problems that may arise in representing and executing 
various knuls of instructions. The theoretical approach also suggests ways of 
niakuig overv day m.slructions easier in coniprelierul. 

EDUCATIONAL TESTS OF VERBAL COMPREHENSION 
Sentence-Complfttion Tasks 

Another dt^niain in which we can apply our inlormation processing analysis is 
the sentence-completion task, which often appears in tests of academic achieve- 
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ment i)r ability. This tusk involves chousing one of several alternatives that 
**besr completes a sentence frame. Consider the following example: 

Beauty is only skm-dei-p, bul ivks all the way to the bone 
a. disease b. blood c. ugliness d. tri^jht c, lirunicnt 
f Answer: c) 

Althougli performance in this task depends to some extent npnn an adequate 
vocabulary, much of the. processing can he explained in terms of the processes 
dcscribeil by the comprehensiDu model. 

Many'*' of the items In a sentence-completion test have structures that are 
basically like the example above. These items consist of two parallel clauses of 
the same syntactic type, although there may be a negative lurking in one of 
them. The missing item is a constituent »)f one of .the clauses. The connective 
between the two clauses is either affirmative (e,g,, and) or negative {e.g., hut). 
'I'he polarity ni the conr?ective> as well as the presence of a negative in one of the 
clauses, determines whether the missing item should be an antonym or synonym 
of the ci>rrespondini^ ^ oiistifiienl in other clause. In the example above, the 
negative ct>nneclive hut l^ a cue thai the answer is an antonym oUwauty. 

A number of examples will ^ive the tlavor of the kinds of sentence completion 
items that involve negative connectives, like yet, hut, u/ilikc, whereas, and 
althouf^h i iiikcn from a booklet, hrparatioii for coUci^c hoard examinations by 
Flenry Regjiery (\)., I^?^:, pp. 107 126); 

Unlike his i,Ljusm, ihc artist, who was color! ul, whimsical, and erratic^ the teacher was 

a. inlallible Iv toinnionplaie c, t^bjecUve d. disorwni/ed e. subtle 

rhouj:'h he Was mnKuUii and seiiMjal \\\ his nutit)ok, his lite was one of 

a. protli^atv b. naivete e. aiisferiK d. virtuousity e. maturity 

These C(»ndith>ns are nol the nature nl women* but have j^'rown up in spile t)f it. 

a. iiUruisJi f'» b. paraiuotml jn e. toinpelhnrin ^ d. immutable in e. exlrinsic in 

i;arl> in the l^^ffi vi-nfur;, ui the Si»utb, it liad betnme the la^luon to raise only one 
staple cr'»p, whereas in the North the crc»ps were _ . 

a. diversitied !v unsUible c. lallow d, iinil'orm e. wild 

in tliis iMHU- he was \n unalt-ur, uiti an evprrl, and thus, tor the lirst time, beeame a(n) 
instead «>f a m,in < ft at tinri. 

a. cnnnoissmir b, spe^ tatin c. lawyer d. prainuatist e. iiuthority 

l inguistic analvv's nt [lu- clausal coiiiunction hut show that it involves incon- 
gruence between the two clauses, f ur example, hut may be used if there is a 
lexical contrast belween the two clauses, e,l^, Mary likes se/iooj hut John hates 
it. A second use of hut Involves a contrast between what is stated and what the 
speaker believes to be the usual cotmection between the two clauses, e.g,, /^/// Z.?' 
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a polttiaan hut he \ honest or Dick is a ichrinanan hut he ilocsn'( hkc dogs 
(cl. l.akolL P)7]; Cleitiiiaii. Dik. M)OS). Otlier coiiiiectivcs like instead, 

althni^Ji, in spite t>t\ hnwver, and vet cvuijuiii siitiilar kinds of contrasting 
clauses. 

In an experniiental invesh*j,alion ul the cunpledun ta.^k.OsgDod and Richards 
{ l^n3) askoU subjects to complete «Mitences like A' is heautifid .__dionh or X is 
<^id vA'uv with and or hut. I hc two adjectives in the sciitence cither had the 
same <>r oppi>site alTective polarity, which was determined a priori With* the 
semantic ditTereiitiaL As the linguistic analysis wiudd predict, incongruence 
between the twn lexical items was a more tavv)r:u)lc eiiviroiiniont for butt 
whereas confluence was a more tavorai^lo iMwirtinmcnt \oi and. 

The comparison model sugiiests the processes that might under' io perforiuancc 
in tills completion task, Fiist the sentence is parsed into two parallel clauses. 
Then the ctiustiUuMiis ot' the clauses, including the coordinate conjunction and 
pnlanty nuukor^. are checked senalls' for their polarity. The number of negatives 
dcloniiines wliother it is a synonym or antonym ol the provided constituent that 
is i)Utput as a fe>[n)nse, . 

This ukhIoI of priKcssiu^' can be lestetl w itli data collected during the sentence 
completion task. lioi>sam {l'J7>) measured latencies while people completed 
sentences like those m the Osgood and Richard's task, and lie also varied the 
number of explicit negatives m the sentence. F'or example, a sentence could 

ufyulvo adjectives of similar affective polarity (e,g.. Eve wiis mild fiice) or 

opposite atYective polarity {e.g., Carl was tnndyled and could contain 

either no neuatives at all. one negative (e.u.. /'.i^' was mild not niee) or two 

no^.i rives (e.g.. /'Vc was n^n niild _jiot nice). 

As m!i:lu he expected, latencies increased as the number of negatives in tlie 
s,enferice increased from zero to one to two. burthermore, latencies were shorter 
when tiie twv> .idjcctives were coriiiruent in at'lective polarity. This dift'erence was 
lu^t attected by other factors, such as tlie number of extra operations caused by 
I ho pirscnce of additional negatives. The results jrc ci>niplctelv consistent with a 
priHOss that vcn.illv checks the constituents of the sentence. The presence of a 
negative rc>uhs in a ml^llUUl•^ between the sentence representation and the 
affirmative frame witli which it is compared. Sucbi iiiismatches cause extra 
'iper.it hi! IS. whose durations are additive. Ill us. the basic pr()ccsses involved in 
\\\\\ -.enfi-nce c'^mpletjnn lask are tjuite similat to the t)nes involved in coiuprc- 
lienduiii and vcntyuig sentences, although (he control structures may be dilTcr- 
cut l^>i the two tasks Processes m both tasks involve serially examining the 
ctuisfink'iits ol i.-pres'e,n fafinns, encnnntering mismatches, and C()nsequently 
pcrlornung addilii>nal mentiil operations. This analysis has attempted to show 
that performance on a common item Irtun a test of verbal skills can be an- 
alyzed in terms of underlying mental ojieratu^ns fourul in other comprehension 
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Potential Applications: The Reading Comprehension Test 

In this section, wc will try to outline the kinds of representations, reirieval and 
comparison operations anotiier task involving verbal comprehension: the 
reading comprehension test. This task is much more, complex than the other 
ones that we have analyzed. Tlie reading comprehension test involves reading a 
passage, usually 150-500 words long, and then answering 8 to 12 multiple-choice 
questions about the passage. The instructions are to first skim the passage then 
read the questions and return to the passage for information when it is neces- 
sary. The time allotted to read the passage and answer all tile questions is usually 
5 to 15 minutes. We studied this task by having three subjects express their 
Strategies and thoughts aloud while they performed several reading comprehen- 
sion tests. Thus, this section represents a potential extension of the general 
approach, rather than an empirically confirmed model. 

[)uring the initial reading of the paragraph, the theme or central proposition of 
the passage is gerterally extracted and represented. Our subjects indicated they 
had represented the thematic information by their ability to answer the ques- 
tions about the theme without looking back at tlie passage. In other studies, it 
has been shown that if subjects are kept from knowing the theme, both 
comprehension and memory for the passage suffers (Bransford & Johnson, 1973;- 
Dooling & Lachman, 1971). Also, when recognition memory for individual 
sentences in a passage is tested, there is a much higlier falsd-alarm rate for 
distractor sentences that ctmtain the theme (Singer & Rosenberg, 1973). (See 
also Hyman, Chapter 8, this volume). These results indicate that the thematic 
information plays a central role in the representation of the passage. 

The initial representation of the passage, also contains information about 
higher-order relations that exist between the thematic proposition and subsidiary 
propositions. These are relations such as causality and temporal order of events, 
which are sometimes cued by words like because, consequently, after, before, 
and so on. The representation of individual propositions lir^ked by higher-order 
relations can he accommodated by a number of representational schemes (cf. 
Crothets, \^)12\ Kintsch, 1^)72; Rumelhart, Lindsay & Norman, 1972; Schank, 
1972). Subjects often stored the occurrence of such higlier-order relations 
without storing the content of the subsidiary proposition. For example, after the 
initial reading a subject might remember that the consequences of a certain event 
were listed, but be unable to recall the specific instances. 

The third kind of information extracted during the initial reading is a represen- 
tation of the information development in the passage. Subjects seemed to store 
information that could act as a pointer to a particular part of the passage when a 
question retjuircd specific infiirmation. In a sense, the printed passage was used 
as an external memory, and the internal representation served as an indexing 
system for that external memory. Our subjects often knew where to look in the 
passage for specific information. For example, if a question alluded to a specific 
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tact, tlie subject would say remeiuber soitictlung about that just before the 
: eiur* or . . . that appeared in the middle/* Than, he would proceed to search 
thnnigh the appropriate part the passaue. Of course, some of these strategies 
are piobahly due tn the task condititwis. which einphasi/e speed, but permit 
subjects to look back. In sununary.^it appears that alter the initial reading, our 

subjects had a record of the locatimi of certain information in the passage, as 

well as the rnani theme and a list of siMiie relations between the theme and 
suhsuhary propositions. 

Our appri>ach to the reading comprehension test is to focus on representing, 
indexing, retrieving, and cortiparing information. Although our approach de- 
emphasi/es the obvious I actor of vocabulary, i.e. previtnis knowledge of the 
words in the passage, experimental evidence? suggests that such de-emphasis may 
be justified. Tuinnun and Brady { 1 ^)73) showed that thorough pretraining on 
vocahiilarv items from the reading passage did not raise the comprehension 
scores of children m grades four to six. While some minimal knowledge of the 
vocabulary is cle.nly a necessary condition for successful performance, it is not 
sufficient to improve performance beyond a given level. This study suggests that 
the important skill in roading comprehension is the ability io represent and 
manipulate the Int'oanation presented in the passage and questions. 

The advantage of analyzing the reading comprehension task in terms of 
information processing theory that U defines the relevant empirical questions 
tn be answered. One process to be explored is the mechanism that abstracts the 
theme. I'OT example, it is possible that the thematic proposition is the one that 
occurs most frequently in the passage, :is suggested by the Simula tiim model of 
Rosenborg (1^)74). Another issue to e explored is the precise representation of 
the indcxir^g system that records where facts were mentioned in the paragraph. 
Vet anotlvr is the determininatKni of how particular questions tap into this 
index. This analysis provides art outline of how a complex task like the reading 

— comprehensii^n test can be approached in terms of the basic components of the 
comprehension process the representation, retrieval, and coinparlscu of infor- 
mafitaL 



What Makes a Seruence Hard to Process^ 

fhc compr«*hensjnn nunlel makes the claim that a sentence is difficult to process 
when it doesn't match the rcfnesontatton of some sec(Mul source of information. 
Thus, the critical variable that deternunes priKcssing diftlculty is the number of 
matches <u irusrnatches between two representatiiMis: the critical factor is not 
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affirmation or negation, per se. According to the model, negatives are harder to 
process only when they mismatch with tJie affirmative representation of other 
information. For example, pictures are generally represented affirmatively, so 
sentences that refer to pictures are generally easier to process if they are 
affirmative. Similarly, the information stored in semantic memory is usually 
stored in some affirmative form, so the comprehension of the sentence referring 
to semantic memory is usually easier if the sentence is affirmative. However, the 
implication of the model is clear-negatives are not necessarily harder to process 
than affirmatives; mismatches, rather than negation per se, determine the ease of 
comprehending linguistic information. 

When Negatives Are Easier 

The model predicts that a negative sentence should be easier than an affirmative 
if the information frpni the other source were represented negatively. Then, the 
negative sentence would, match the representation of the second source of 
information and the comparison would be faster. By contrast, the affirmative 
sentence would mismatch and processing would take longer! In fact, our analysis 
of an unusual reasoning iask supports this prediction, Johnson-Laird and Tridgell 
(1972). presented subjects with a disjunctive premise (p v q) and a probe (~^), 
and asked the subjects to draw a conclusion (p). The premise contained two 
clauses llkQ i^'itfier John is intelligent or John is rich. The probe sentence always 
had a different truth value than one of the two clauses in the premise, for 
example, John is myt rich, so the conclusion was the remaining clause, i.e. , John 
is intelligent. 

The task required that the subject iisk himself whe^ther a clause in the premise 
contlicts with the probe. This self-instruction may have caused the same kind of 
internal representation that we postulated for instructions involving conflict, 
different, and disagree. The relevant clause in the premise may have been 
encoded into negative instruction and then compared to the probe. For th** 
example Fithcr J(>hn is intelligent or John is rich, the second clause may have 
been coded into the instruction: (Nf:G, (Xj), so that it resulted in the represen- 
tation (NEC, (RICH, JOHN))' This was then compared to the probe, /o/z/7 is not 
rich, represented (NEG, (RICH, JOHN}). The model predicts that such a 
negative probe would he processed faster than an affirmative probe Wk.^ John is 
poor, represented as (AFF, (POOR, JOHN j j. As predicted, the response latency 
to negative probes was shorter (by 1,6 sec) than the latency for the affirmative 
probe. The model correctly makes the nonintuitive prediction that the negative 
probes are processed faster in this situation. This supports the argument that 
mismatches, rather than negatives per se, consume processing time. Thus, it is 
the relationship between two representations that determines the speed of 
comparison processes. 
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ProcHSsinq IrHtructions in an Everyday Situation 

It was leceriiiy nIiowii thai in a liighlv roaIij?tic situation, people remember 
attirmative in>triution^ much bettor than llieir negative counterparts. The situa- 
tum was an airport, where eighty waiting airline passengers were asked to read or 
hsten to a lOi) word fiassage de^cr!hing in-flight emergency procedures, based on 
actual airhnc protocol (rile & Jew, 1^)73). The individual instructions were 
eithor aUlrmative (e,g., h'xtin^uisli d^arcttcs. RcnKn'e shoes.) or tlie correspond- 
Uig Dcgutive ^et (i:.g.. A> tin leave eigarettes lighted Do not keep shoes The 
results showed that the passengers recalled about 209' more information from 
atiirmativc mstiuctinns than fiom negative instructions. The better recall of 
aftirmative instructions may have beeii the consequence of fewer mental opera- 
tions during comprehension. Because the aftlrmatives are comprehended Paster, 
^ul>iects mav have hud nuue time to transier information into long-term 
fn^Mn*»ry^ Ihe sigmlicance oT this study is clear: laboratory-based theories of 
ctimjneheasioii di'> apply to real situations involving critically important instruc- 
tioiis. 

We have examuied several tasks that involve verbal comprehension in instruc- 
timial settings. The tocir has been how the information in a sentence is 
represented and manipulated. We have proposed a general model to account for 
comprehension m a variety of situations, such as verifying or completing sen- 
tences, and executing instructions. The kinds of tasks surveyed and the analysis 
have both practical and theoretical importance. On the practical side, this kind 
t^f analysis may help io localize the difficulties that an individual has in verbal 
c«'mprehciisiurK Moreover, this approach could lead to a set of rules for writing 
easily comprehensible instructions. The analysis of these tasks in terms of 
tundamenftil processes fielps to unravel the. Cii^rdian Not of verbal comprehen- 
Nion. 
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In the ninth Carnegie Syniposiiini on Cognition, we described the processes used 
by Iiunian subjects to understand the instructions in a problem-solving task 
(Hayes & Simon, 1974). The aim of tliis cliapter is to build upon the theory of 
the understanding process (and the UNDERSTAND computer program) devel- 
oped in that previous paper, and to draw out the implications of the theory for 
edujational processes and practices. The discussion will be organized under three 
main topics: the UNDl-RSTAND theory and some directions in wliich it needs 
to be extended, the role of prior knowledge iii understanding; and the pedagogi- 
cal implications of a theory of understanding. It will focus upon a strategy for 
analyzing tasks with a view to discovering what is involved in understanding 
them. 

Much concern is expressed, from time to time, about "functional illiteracy" in 
our society. A functional illiterate is someone who cannot perform tlie reading 
tasks witii which his job and his daily life confront him. The illiteratp cannot 
read and understand the directions on the medicine bottle, the do-it-yourself kit, 
or the soup can. He cannot understand the fine print on the traffic ticket or read 
his personal mail. He cannot read the instruction manual for a piece of equip- 
ment used in his job. Although only a modest amount of research has been done 
on the causes of functional illiteracy, the data'that are available suggest two 
generalizations about it. 

1. Functional illiteracy is primarily im understanding problem, rather than a 
reading problem. That is to say, most functional illiterates in our society possess 
the basic decoding skills for reading the printed word. What they lack is 
adequate vocabulary, knowledge, and skill to interpret the communications that 
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are diroctLMi to them, rL^gardless of whunlKM those communications are written or 
spoken. This has been demonstrated very convincingly by Sticht (1972), who 
has slunvn tliat if a person can understand .m oral communication, he can almost 
a^^vavs understand the same comnuim.ation presented to him in writing, and 
vij:o versa. Hence any major attack on adult functional ilUteraey must be 
directed at improving language understanding skills, and not simply at improving 
thje decoding skills of hegin[nng reading. 

p. Much of the ditTicult language that an individual encounters in daily life is 
fotimd in . the instructions he receives about what io do or how to do it. 
Tljeiefore, any major attack on atlult functional illiteracy needs to place* special 
en.!iphasis on tlie un[)iovement of the skills ol untlei standing instructions. 

• If understanding instructions is an important component of functional literacy 
foi adults in their everyday and workaday lives, it is an even more crucial skill 
lor cluidiiMi. adok'Sv:ents, and young adiiUs who spend their days in school. 
Sch'U>ls (including universities) are the most persistently evaluating institutions 
m our Society, [hey are continually testing their stiidents, and the heart of 
tcstir.,^ is deteniiinnu^ whether someone can carry out successfully a set of task 
mstrnctions. Someone who cannot utnlerstand instruetitins cannot pass tests. 
Hence, iHuleistaniling instructions is one *>)' the prineipal skills we test in the 
sch*»ois. 

But the understauiling of instiuctuins enters school tasks by still another 
route. Scljools teach, or attempt to teach, jheir students to solve problems in a 
wide lange ot dnniaihs. The first step in solving a problem is to imderstand 
It that 1^. to make a meanmgful description of the problem situation (This view, 
that til unileist,md is tc^ make a description of the situation, is chiborated in the 
ne\t ^^^ llnn.) But a description of a pri>bleni situation is nothing more nor less 
llum an insfiucU'»n tluit defiiios a task and requests tliat it be pertormed. Hence, 
a significant component {)f problem solving skill in any domain is the skill of 
understanding Ihe instructions for problems in that domain. 

o 

THE NATURE OF UNDERSTANDING 

On * iiiidcrst uuU task instructunis if he can program himself to attempt the 
i.i.sk I hi. do'^'s not neces^arily mean that he can perform the task successfully.. 
Miisf people can readily understaiul the l our Color "Hieorem: Any plane map 
can bo colored with not mc^re than lour colors in such away that no tei-ritories 
with a conmit>n b{»rder have the same color. If a person knows what a proof is, 
he can progtain iuniMdl to respond to the instruction: 'Trove the Four Color 
riioort'm/' Ihs chances ot >ni*, css, however, are nuniscule; in spite of the efforts 
of numerous first-rate niathematicians, no one has succeeded in finding a proof 
of the F'ltur C'nlor ITicorem or, for that matter, a disproof. 
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Wliat, more precisely, does it mean for a person to understand a task (hat he 
may or may not be able to.perforirt? At a minimum, it means that he can test 
' the adequacy of a purported performance or solution. But ordinarily, we expect 
something more than tliis minimum of understanding. A person approaches a 
new set of task instructions equipped with certain sximewhat general problem- 
solving capabilities. Somehow, lie enlists these problem-solving capabilities in the 
task which the new instructions present to liim. The process of understanding 
the instructions is precisely this enlistment process. 

A Specific Theory of Understanding 

] 

In our previous paper, we rep6rts|d_on the UNDERSTAND program, a computer 
simulation of the understanding pfrocess. The UNDERSTAND program e'hibodies 
the following theory of the process. Before any specific problem can be 
attacked, it must be described in' terms of a problem space— a space of situations 
that may be visited in a search for a solution—and a set of operators 6r '*moves*' 
•for changing one situation into another in the course of the search. 

Consider the problem of choosing a move in the game of tic-tac-toe. The 
problem space here might be the space of possible game situations, of arrange- 
ments of crosses aiid circles on the 3 X 3 array. The move operator adds a new 
cross or circle to the array. Given a way of representing the V4irious possible 
game situations, and a^way of moving from one to an other of these, a problem- 
solving program like the General Problem Solver, GPS (Ernst and Newell, 1967) 
could go to work on the task of finding a good move in tic-tac-toe. (Actually, 
GPS would need a few other ''givens" beyond those mentioned above, but the 
problem space and tlie> move operator are the central requisites for it.) To ask 
how the L.INDL-RSTAND program goes about understanding written problem 

• instructions is to ask how it transforms those instructions into a problem space and 
a move operator. As we showed in our previous paper, tliis is accomplished by the 
UNDHRSTAND program and. by human subjects as well, along the following 
lines: 

1. The input instructions are analyzed syntactically by means of a parsing' 
program, / 

2. A search Js made through the analyzed text for sets of '^bjects" that need 

• to be represented in the problem ^ace, and sets of relations among these 
objects. 

3. A structure is created that permits objects and their relations (and thereby 
situations) to be represented. The representation is used to store information 
extracted froiji the problem mstructions about the initial and goal situations. • 

4. A search is made through the analyzed text for operators that change the 
relations among objects. 
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. !!vr "r\ Mf^li 'tl I ^! jn . jbl ' ^otn.l^^^K i!;tcf pictatinlis of the 
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r. . : '■: ' : * ' j.i!:-. Tii.J ^h: wA^!:\'^.pi'.:uhu.! vhaniV'^ iti incuv^ry stnictures* 
' I!} - j-'P" ' 'r:^^^5 »:! .Ttvtt.'d m -^rp i >} is Joscnbcd. to prrivuie the informa- 
n ; : ira: * 1 * V !h.M!;ti*rt:n.*t v.I ,hjiiLT 'pei.!t'»rs. !ho i^pcMlors have thv* task 
A, Ut.il:. .niw.i,: u» fii • ^ !!oiu '!k* ,j!u.itu»n t^- ait^>Uu'r by making the 

I -.re wliM -.uh ^'..'r' means \u terms .'t .1 simple, cnurete example. Table 
I V irisr-iKtinrr, ^ >r a "M*in'>lcr Piohlei!!." Ihe tlrst step m understmid- 
i :j 'fi t: !% f ' t-'i rhi' suttave sfnufmL's nt the cumponent scn- 

^ 'i^, • t* f / pr M fM"iii Mins Mid uMier nijAvafd lelereiiivs, and lo carry out 
'!h.*i !a>l\. this kuui that \vo!ild be [>ert««rn)ed bv a parsing 

/ • ' , 

n • • ^ ;> I. t»* id»'iirit\. m Uie syntactically >maly/ed sentences, the 

> V * r h!\,m!v- : ;» th,' pr »b!i'm: in tfus case monsters and gh^bes. Sinularly, a 
.mbfi t't r -titi ns ..an be identified monsters are ordered by si /.e, as are 

fji^Mf a: T-"lati »n. 'liMldini?" anvl t>t "teleportin^;'' 01 **givia^/' 
In iW thn i ^r ,'p. t wav rnu,t lu* found lot representing .situations in which 
p iffividji T!ioii^rer . h^^Id particulai idt*brs. In a memory capai>le oT storing Hst 
.^Mi tur '., vidi a rt'f)resent.ifion is reaihiy c»»nstructed as foiU>\vs: A m>dc Is 
: • I l^^ .TAT!i>*rv labeled "( un-'nt Situalinn An altribute/Wlonster-List/* is 
r lated With thM node, having as its vahie a list of the n^tmsters. **Monster.l," 
•^M^^n^t-f and "Mmister. r*' With each monster node is associated an attrib- 
**Si/'.'.'* iMvme j> wilne "Small/* '"Medium " or **Large." A second attribute 
i.aMi!-d witli K\u:h iT^urut.-r i. ''(ih>besdleld." Ihe value ot 'XilobesdleW is 
i;\ti!i.a h^t th^' rtauM"-. t»t ^},x' iii^'be^ currentiv held by the monster in question. 
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A R*»prt*«ient.i^} :.m i}f the Ifutr.ii SttUfUK;n for the M?.>nster Prol)lf?rn 

S\:c Mcdniiii - 
iil.^bc list 
(Atyhc, 1 
Si/.' Smill 

M •tkUt. ?. 
\! risfr ^ 

M ^R' Ip.f 
i ll Ah: ? 
Si/r Moiimni 

Hach ^Itihc is described by Us si/e m the same way as the monsters are. The 
entire represent, l(n the initial pr(ibleni situation is shown in Table 2, 

As fourth anu fdi steps, the move operator must be identified, and it must 
receive a semantic interpietation. In tins problem, the move operator rnay be 
represented as 

(iIVI S((rlnh^\\, Monstc i .\ , Mnnsior ./ ). 

Whieh may be read as; "Mi)nster Y giv^Cdobc A* to Monster Z," Notice that this 
operati»r involves i>ne object belon^in^ tn one class {gk)hes), and two objects 
beloii^un^* to anorher dass (monsters), [his characteristic allows (ilVI S to bo 
interpretevi as an instance i^t the MOVI- opeialt^r wliieli is already stored in 
long-term memory, along with programs that, when provided with appropriate 
information abnut the representation, can actually carry out the move: 

MOVI (1. !.//!. 

The operatuui of nuwing .1.1 Ironi IL\ to If 2 consists in deleting the relation in 
the repS?sentati(>n u| the situation that holds between .1.1 and /i.I, and then 
establishing the en responding relaiinn between A A and />.2. How this is to be 
done depemls nn ^h-^ way in wbiih fhe relation between the Is and the /is is 
actually represented in memory. 

The sixth step, tlien. is to provide the MOVT: operator with the iiiformation it 
needs in.urder to act upon the representation td' the siuiation. Tlus is accom- 
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ph.lRvi hv ristiUvtiriii i ticsvur>M"!i i *pi. si'rWaLmn (a Inrniali/cJ version 

fli * I iii'n.h-Ltn.'u.r.v ^kscnptiMfi we pr 'vukul a tew paraurapli^ earliei ). Using 
thr { : pf;.^ii rh- MOVl p :uuv intorprot ^Alouj^ter } gives Globe 

A M I. rn.Mi:i!it» thjt ^ \ is t.i he deleted ixom the value list of 

i^f'itoiT. 11 I 1 ,,f \r,na.M } tiij (o !)e adtled to the value list of 

th-* a^t!:M.:' - (, .*iu' [I 'j.i Mni f "/. It (hr ,itiiuinn had been lepiesented 
ditrcreiul'v hv .tnriik! rlie li^t fj.ihes. sav . and associatnm with each the name 
tiio iiuni.Nt.'r holdiiiL! ;t thei: the aetual op^Tatinn ol making a move would 
h.ivt' ^eeri altered a^cffvlutglv . Iv that casc» the move wtnild have been made by 
deierra' the d.Miaruu* :nMuster\ association with the transtLTed globe» and 
a^st»;iatin- the leceiMii;.^ mon ster wnh that ejobe. In eaeh mstance the. processes 
<»r the MOVl- npeiatnr would be controlled by the tlescnption of the particular 
representation w use.' 

Ir^ .ununaiv. fhe I \F)I RSTAM) tlieor> asserts that a person understands a 
problem Iik'* ^h: Monster Problem it he has c«)nstructed a representatii)n for 
piohlem >ifu,ini>n:. {po>^ibIe distributions of globes among monsters), and if he 
can consider hane?"> ui thf problem situation corresponding to legal nioves and 
aciuallv ranv '»ijt those chanee-^ ^ni the stored representation. The reason for 
le/arduu^ ihis as uiidvrstaudmg is that, etpupped with this interpretation of a 
[nobletn,a pn^bleui solver can attack it by applying means-cMids analysis to it. He 
.ari tletefinine m wb:it respects the goal situation (all mor-.ters holding globes 
pr<*porfiofiate v> tVeir t^w ^ si/cs) difteis tiom the initial situation, and how these 
ditter'-nces m\t\hr he remove ' by applying the MOVl' operator. We repeat our 
earlier vaution sa> that the \ robleni has been understoini does not imply that 
If K\it\ he solved either easily. «»r at aih 

Oral v^Tsus Wtitrt^n Instrtu Tion 

All the steps in the understanding pri)cess that have been described are 
t'ssenrtal. legaulles^ t>f whether the task instructions are received lually or in 
AJititie cit^'tl earlier ^onie t^mpincal evidence (Sticht. hJ72) that for adults 
fhe ditli. ultv i'l untlerstaruhng instr u^. tions is largely independent of instruction 
rM-Kia!it>. !I(»wever, there are some diiferences between nral and written coni- 
i-nuiii:;Uinti that can at'teet understanding substantially. 

fh-' nio.r nuf^nrtaiU distinction is that oral instructions may exceed the 
. ip.i Uv Un)V^ m| diMit-term memory, boi example, it would be extremely 
diMi,.iilf lindersr^^ul the Monster Problem m Table 1 particularly the legal 
ir^'v, ttn ,{ nral presentatioiL Subjects who are given the problem in 

' f»' '-i''. ■ ii fli ^ \Pi i* .1 '.^r itn - .irrh-, nit rluNr vfops ui* pnniileil in our 

:is p iV'^' 'H,:'..^ \ Sjiti .lu \ r:.\), in ?j>jt p.jpi-r. ur (^l^ct^ss h^nv the rule 
. -r'.ir^ r-. 'Mri' !"r,icjfi up,,ri ah - niav jw-: ^[nlvs : » uIii^m* .irt* iiUorprotcd. The 
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writing hamile the STM capacity limitation simply by rereading the more 
complex sentences a.s ot'ten as they need to. The ocntences stating the limitations 
on transfers of globes and the sentence describing the initial situation are almost 
always read a number of tunes by our subjects. The other sentences are usually 
read - and apparently understood in a single pass. Tlie UNDl-RSTAND program 
makes a number o[' successive passes over the problem text, and is allowed as 
much short-term memory as it requires. Hence, it approximates more closely the 
conditions of reading than of listening. 

Another difference between oral and written instructions is that the former 
contain stress and mtonalional cues, vvliile the latter contain punctuation. 
Although these differences co\\\d have important effects upon understaudability, 
we believe tliat ni fact, the effects are usually small.- The UNDfU^STAND 
program, a.s it now stands, makes use of punctuation a$ a cue to meaning, but 
not italics, nt>r stress and intonational cues. 

Envirorimentdl Feedback 

Knowledge of results is crucial io any learning process, and the understandin} 
process should be no exception. What knowledge of results does the UNDER- 
STAND program obtain in the course of acquiring an understanding of the 
Monster Problem'* [low does the program know when it has understood? 

The program can detect whether it has succeeded in formulating some prob- 
lem, but it cannot giiarant^ie that the formulation is the one intended by the 
.problem statement. The program's tost that it has performed its task amounts' to 
detecting that it has constructed a representation of the problem situation, that 
it has detlned a move operator, and that it has interpreted the move operator in 
terms of the representation. 

In some real-life understanding situations, and in many scnoql situations, 
feedback is correspondingly limited. In many instruction-understanding situa- 
tions, however, the problem solver can seek cues to help him or her interpret the 
problem situation. Subjects solving the Monster Pr()blem ask the experimenter 
such questunis as **(*an a monster hold more than one globe?" Does the 
problem have a unique solution?'' *'May a monster pass a globe to any other 
monster, or only to the monster standing nearest to him?" Answers to these 
questions narrow ilown the possible range of interpretations of the problem. 

In many other, cases o\ real-world problem solving, the task posed by the 
problem instructions is to carry out some external physical actions that have 
observable physi« al effects. These observable effects become another source of 
feedback that can be used to aid problem interpretation. \Vlien someone tries to 
follow the instructions i^f a do-it-yourself kit, the success or failure i)f his actions 
soon becomes apparent, md this gives him critical informajtion as to the 
adequacy of his understanding of the instructions. If the instructions refer to a 
particular component, and he cannot identify that component from.the parts 
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lii fi bril iiiiTK iiv* kiu»'A > tim he docs not luulcist.iinl tlic iiistnu tions. If 
the iiist! foq lire UV'» putts ti^ ho a.sseinhloti lluU he v.a!innt tit lt)t»ethcr, lie 

!'..ri-\v. riMt jr.* ;jrnl^r%Kiiui the jii^MUs tioiis. 

Mh' hriiitifiK' - asc thi i * ar/ no verbal instructions at all only a situation to 
be un.ief 'vi an l iealr Aitli. \ leakm^' i:i\u:c\ is an instruction i\ inc." Tltis 
hinititi:: .A^i' !^-ninui. u» rha(, \n nian\ real-hk^ situations, intorniation for 
!^^lcr^^lInhnL' vvliaf In to bo ilone is ihavvn lo.«> troni exphrit instrnctiniis than 
tr.!fu \iu\i peueptii.4'i ^^l the siiuatii>n (it is drawn also, ot ctnirsc, Irom 
l»ru'O..M|jj ruemni'v , a p^inr that we sliall discuss hiier.). 

Iti ."'n,' I ^-sph.n Uist! nclioiis are acconipanied by Worked-oul examples. 
I!u. d^ fjr , ontuioniv in ruaihernatics textbooks, computer prograniniing 
niaii iaU. atul UKtr ui. tioti > subjects ni psychoh>gical expeiinienls. hi these 
^it.i tttMif^ the examples inav suppK surricient inlorrnalion about the task and its 
i^'fj-nr TiiiMitw t" n\Akc the exphcit task instructions superlluous. This possibihty 
h u h:^'u d."?;h^n ,rt.if -d bv Donald Williams ( 1^)72). who conslructed an ariincial 
ntt.'nuvn;.i' >v r that prnpranis itselt to lake various kinds of intelligence lest 
fMlt'.-rit'. ( ' . i.;:t''i .dies ..onipletuni. number aiiah)gy)oii the basis of worked- 
*»uf '.-xaTTiples. at*'i wnlio'ir --xfilivir verbal msiruclioris. 

Peifiip. fh.' inw>r inioto.tnii' ^,ase>. aio those in which a subject receives 
teiMlf)a.K Ut.in Mio wnvrqUv'iice-. ot Ins alteinpts to lotiiuilale and solve the 
prohlem. F nr exanif^k', a lulijcct (described hy Haves cV- Simon, 1^)74) read a line 
-«t T,-\t ivd concbided that the pro[)ieni iiTVolved two participants. The next line, 
b- ^vs.'ver, ntipiie.i th.it theie were three participants. At this poiiit. the subject 
. jt'Ouliv rcexanuft "d I' li.h "t" the soritences to resolve the coiillict between them 
i'>^'t-i*' pn >i tvtiiri;; \K\\U his ^oiution .ittempt. This example illustrates a simple 
pov.'.M'ul iteutr^ih; toj redujiiii^ loe il ambiiiihly that is not iiiCiHporated in 
*h'- pi " etii I \I>1 RSI WI) pp Lorain inlerenccs drawn from one part of the 
j>i >bk'ni :niist f>o rri.ide ^^u^^i ,tori^ with inferences drawn I'roni other parts of 
th'.^ i-'Xt. 

Ani-rfit'^ <-x.ifupIe th? .isc ot tins iieuri^tic bv the same subject involved 
i:}\-i|.r f ' t ,^t' n' *tit >t til ' tuiin, *V\ docs a task lor H," hi one part of the 
rrr.t. -lu^ , iHir, f ifU'^i I'teicd rhi% stalemeiif to mean that 'VA does a task to 
^'.r'.iit f^** vUnl; hi in-*thet. he uUerpteted it to mean that '\\ does a task 
ui-'ea i 1? 15." [he s\ihw'^t\ lecoiiniiioii and resolutiiui n( this conllict played an 
i!{)p^ 'I f I'i^f III .uv i '/sshi! tormulativMi ot" tile prolilem. 

11^* »ri.!.r/ii'\ h'Min.ti. u t^>t the only one that stibjecls use in derivhig 
t'/^'d^vt, r. ♦^.Mi ♦h *H ;itr»*Tupr> to ,L'Ke a pn^hlem. \Vc have also observed a 
** .'..bv.rnht h.; irt>M ; bemi: employed^. HrieHy. it Worked as lollovvs: the subject 
f".\p-rliev.i/<- 1 .1!! .;x"iaror tMi a problem. Then he discovered that the problem 
..M.iiihi^f hr v>}\"ii thiv ..p.-iaioT IK" ihon concluded (hat the operator was 
inappt i ^p: j.it ..\ .trid |iv p> 'diesi/ed a new uuc 

In v-iU]v.\Ar\ . the task ot liiuL-Tstandniii uistruclKuis w hen there is environ- 
nieiital tev-dn.u -. i> veiv dilterent trom the iituier\landing task in the absence of 
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such feedback. Feedback may result fri)m ability to questiiin the instruction- 
giver, access tt) the actual problem environment, access to worked-out examples, 
or the use ol consistency and solvabihty heuristics. In hmiting cases, the 
information available [toiw these sources o{ feeilback may be so complete as to 
permit the task to he understood without any explicit instructions at all Before 
it can be regarded as a comprehensive theory of the understanding processes, the 
UNDFRSTANI) program will liave to be augmented to hanille these possibilities 
for feeilhack. 



WluU does the pioblem solver have io kni)W already in order to understand i\ set 
o\ problem mstiuctions ' Ihe ilescriptiim abi)ve of the processes used to under- 
stand the Monster Prnhlem unply that the kiiiiwledge requirements for under- 
standing are rehitiveiy hmiteil. This kind i)f puz/le may be atypical, however, in 
the slight demands it makt*s upon storeil infiirmatiiin. 

lll-StructurfKl Prohh»ms 

In the literature of problem stilving, a distinctiiin is i)ften made between 
well-structured problems, on the tine hand, :md ill-structured problems, on the 
other. (NewelK Reitman» 1^)64, 1^)65; Simon. 1 973) Not all authors have 

defined the distinction in exactly the same way, but a common theme running 
through all of the definitions is that problems are ill structured to the extent 
that the problem solver himself must ciintribute toward their definition. Specif- 
ically. >ve propose that a pri)blem be regarded as ill structured to the extent that 
the subject must buiUl the representatiim he uses to solve it from information 
.generated during; his unsuccessful attempts at solution. 

The ilistuiction between well-structured and ill-structured problems describes a 
continuum anil nut .t- Jkhotomy. Mc^retiver, the ill-structuretlness oWi pri)blem 
may take a variety of forms. The problem instructions may be couched in 
technical language Uiat can be understiuid only by iine '\skilled in the art.*' Here 
is an example, from a chemical engineering textbook, of a problem that appears 
ill strncturet' prmtarily because of its technical vcK^abulary: 

A throtUirm calnniut^ter is attached to a line tontaininj; stea.n at 15 psig witii a quality 
of What docs the tJiernu) meter in the calorimeter read'' 

A problem may also he ill structured because the instructions do not contain 
en{>ugh information to permit a usable problem representation to be inferred 
from them. As a matter of fact, the chemical engineering example illustrates tliis 
potentiality i'or ill-striicturedness also. Tliere is. nothing in the problem statement 
that indicates huvv the tt^mperature of steam can be calculated from its pressure 
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and quaiuv no definitions ot •*Tnovo oporatiT^'* arc Niipplicd. Ihey must come 
from t\it: kiiowlcdije. If this knowledge is readily available ti) the reader, 

the |Motik"in ^wll appeal well struetuic^d to him. if accessing the knowledge itself 
call> Jof exr^-nMve problem-solvint^ enorT>. the problem will appear ill structured 
tohim.lSe-* \<>nnan. denlner, Ste\en%. Chapter oT this volume.) 

\> *nie ot .b.is pimcipal examples o} an ill-structured probL^n .Keitman {1965, 
Chapter 6) exanuned the task writing a fugue. Here the instructions are 
simphcitv Itself: 'Vumpt^se a fugue." Directed to a professional composer, the 
in-itr-i^tiofis define a etnil. fv)r he can recogni/e a tugue when he hears one, and 
cap appiv a vanet\ of te^ts to evalnaie its quality as music. The instructions also 
'niggcst to the LiMiiposcr a nu*th-Ml of proceeding, for they evoke from his 
loii j.feim UKMTUT , a whole oigam/ed system of ounpositional techniciues. If the 
cornpovT does not set his quality criterion t<M> high, composing a'^fugue. may 
br I faUi -r routine activity. I rom his standpoint, the problem docs not 
\*.\i\h app'Mr U' [\] MMkturcii at all. 

UfMlhT'itanHiru} 

Ihe exatfiplc- Lit 'd ib'^v'.* shov\ tiiaf il^^t^u:tu redness is. in a certain sense, in 
the ev-* or rlfc beftolder IViliaps Ihe best way to put il is to say that a problem is 
lil Nrriictiired to the exteiu that ir puts demands on the knowledge and repertory 
or prohk-m-solvHiL* skills of the solver. In these terms, we would say that the task 
cofn[)'isin;^t 1 ttj^Tiie IS quite far along toward the ill structured end of the 
^oiitiTuiuin, not bvxause the professional composer wouhl not know how to 
[>iovi*'N.L bii! becauso. m proceeding, he would have t(; thaw Upon ;i large 
r -pt rti^rv ot knowl^'dgcand skill stored in his long-term memory, and much of 
tbi- nnnht fH-cornc acucs^tble only on the course ot his st^lution efforts. For the 
pfiM>!t unskdl;'d ni Ci)ni position, the problem would be ill structured in the more 
radii. a! .ense that he w-ntld sinipK lack the knowledge that wi>uld permit him 
'•'v.'n t ' Ininmlatc iIk* pmf^lem. much less to strive rt. 

I".*! j'M- .t! fbc niaff'M o! ^frut. tiirediiess in tin. light, wo can ask how well- 
sU\w^'ii::d the MoMMt-r P^^blem b»r tlu' ( M)i- RS FAN!) program. What stored 
kifowlcd^ve di-ON the program draw upon, in ^rder to understand the problem? 
f b:' I NDE RS 1 \\1) program depends primarily upon a knowledge of the 
1 ii:'jr>!i ind oftdarilv upon a knowledge of the semantics of a few 

^M.i> 'PcrH^^r - (in fh.' .aso at liatith \]w MOV'l optMat(»r). [rradtlitu)n to this 
k?:' .'.\t ••'!,'■.'. ir .''.fiejaL fa-.!.-nuiepenilvnt . capability for constructing repre- 

>Titari"::. h .111 ,ot. obj.vjv ^iii^i rehltion^. ami for interpreting its basic 
•P''f st'M > !■! i. rrn , >\ it'prfsentation:.. i'Xv'ept f<u lunction words (e.g., 

. n \ } i i . i f ' , I . '.'Jii. Il ■■,ci\>: .Is i.ik"*. to Identify the 

•■.Jifiir'.. .T! j.jiH', -lij I Nhl RSI \\f) program dor, not ruvd to know the 
rnc.intrsj:. I m^iid. v\"i l>, but >nK the part^ of speeih to whuh they belong. 
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"Monster*' could as well be **Jabberw()ck:'' or "thingarnajig'' ot '\blurb" withi)Ut 
making the slightest difference to the program's operation. As we have seen 
earlier, giving a globe to another monster (**oulgrabing a tove to a blurb'') hus to 
be recognized as ;ui action that can be matched to the MOVIa operator. Beyond 
this, the meaning of **giving'* or **outgrabing" is also irrelevant. 

ft is rath^jr remarkable that this small amount of machinery ;uid knowledge 
enables the program to understand the instructions of the Monster Prtiblem. We 
generally call tasks of this kind "puz/les." It is perhaps their independence of 
specific information not contained in the problem statement that best charac- 
terizes them. However much they are couched in image-inducing language, they 
are, in fact, highly abstract; and the processes for understanding them are 
processes for identifying and further purifying the abstraction. Monsters become 
objects of a certain abstract class; globes, objects of another class; "holding" a 
relation between objects of tlie tlrst class and objects of the second, and so on. 
Semantic meaning of these terms is a **cover/' to be stripped off in the process 
of understanding the task. 

The protocols o\ subjects,, attempting U) understand the Monster Problem 
reveal thl* role of abstraction in the understanding process. Some subjects, and 
especially those who proved nujst proficient at the t;isk, were quite explicit in 
casting out semantic irrelevaiicies. One subject rends, ^'because of the quantum- 
mechaniciil pecularities of their neighborhood," and comments at once, 'Torget 
that garbage/* Another subject, after residing the whole text once says: 

Now there wef^ only three iilobcs altogether. Hut's not rhetoriciU. 'Hicy were five- 
handed monsters . . . that doesn't have much to do witli it, I take it. Tliey could have 
been twti-handed ni()nst».*rs tor aU I care. 

Two ^iubjects, on the other hand, who imported into the problem knowledge 
associated with the meanings of terms failed to understand it. One of these 
subjects became preoccupied with the physics of the situation. He made such 
comments as: *'You can't have two energy states at the same time, according to 
quantum physus; you're cither at one energy level or another," and '*tiie 
medium wants to dri^p it's energy level to small negative and positive- ahh - 
energy levels/' 

The other subject who failed to understand the problem perhaps^stimulated 
by the mention ot ''nu)nster etii|uette/' introduced a social dimension into the 
situation.- lie made such remarks as, "You know, it seems to me if they all 
agreed on an arbitrary standard [of si/e] , 1 don't see that there would be a 
problem." The siibiect saw that such collusion among the monsters would 
weaken the conditions on allowable moves. 

Precisely because the Mtmstei Problem was intemled as a puzzle, the strategy 
of making use ot the semantics of its terms only caused difficulty and impeded 
understanding of the problem. In other kinds of pnrblerTi situations, the same 
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stratc;'} VAiahi be lielpful, ^^r even c>sontiuL In the pu/vle cnviionnienl, liowever, 
ihc.NiK.t'sstuI subjects wore ilioso who applied abstractum tediniques like the 
uii'^-rporari-a in the I NDhRS TAN!) program, 
riie ilistincti'Mi bctwojii pu/zlcs and pri)blenis, like that between structured 
and ill-^tnjc tUK'd problems, describes ,i contimuun rather than u diehotomy. 
Siiine puzzle pr-^bk^ns rt-quue ihe use iiotli semantic knowled^v and abstrac- 
Uon. I he Jabberwoeky probiem discussed by Newell and Simon (1^)72) is just 
\ndi a prnbleuL In this puzzle a tamiliar river-crossing problem is coded in 
nouM'Tivj w uds. riius, "a heavy father and two young sons have tt) cross u swift 
nvei . . iS coded as '\i slithv tv^ve iuid two [uinisy bi)rogroves have to 
out-wiMk- a [funuous bandersnatch." Subjects attempting to solve the problem 
trequentl> mteipret the struig "to uut-wittle a bandersnatcli" io mean that the 
p.KMeipants have to catch or kill sortie creature. This interpretation suggests an 
*'peMfirUi thaf i> .oniplcted when any one of the participants accompHshes it, 
r illkM than when all fhrec do so. It is clear then that the semantics of groups 
.fitsMfu' H'vi-f . i • important for the correct formulation (if the problem. 

S»'rn.inth:s ir> Aiqtn>r:i W^)rfj F'rul)lK'fir, 

\V.»rd pj<4iK'!ns iu sUny [Moblems in algefna pnnide an example of a problem 
vlornaui vsh^re semantic inlonnalion may be used, even though the problems can 
bv understood v.itli laihtr little reliaiice uptni semantics. Several years ago, 
HobiMvv il')hS> i:.instiucted an artiticial intelligence program for solving such 
profiien*s rhat lehcii prituarilv upon suitactic cues. The program operated in two 
%M;^"> ur^i V. ttansi ited the storv mttJ algehraic e^iuations; (hen it st>lvcd the 
e<|iiaMMn>,. 

Ht'bi pi-'^Marn needed to be able to interpret a small number of mathe- 
inatieal terms \n\ example, "e([uais** and its synonyms, ''t'our times as great as," 
"{e-vs than," "twice js many," the names of the numerals, and so on. It also had 
. ^|MV la} vMiuiiific ipjiMiines fui^ haiuiliih^ ii.'C-, laie.antl distance problems. 
}i<. vtfi ! ifu., tr de[i«.*!ided entireK upon syntaclic means for its translations, 
Il-Mi. e. \\> semaTitk-i wa^ fuu much mop,' elalnnate than the semantics currently 
iiu'?rp*'iated in the I NDI RSTAM) program. 

Siif ^-'qik'Mitlv . Paige ind Simon (I'H^O) examined the prtUocols of human 
.iibj.*', \\ v^■ nl•.!n!' ali.vbra Word prv'ibkMn^ to see whetlier the processes they used 
r '.rMrJ-.i * I tfhtv; Hit Mrp< .rated m Btii^r^ow's progiam 1 hey constructed a number 
>i pr'^l>k*m^ rii-.it represented ph\ sically impossible situations. Foi c-xanipic: 

Ihv r;.j;:i^ i -I'-.M^i-r- > ruaf. !ho In ^rv;'!i !U!k*s rlu" nufiUvr liinU's lie li.is. [lu* valiic. 
Mi- !(;',' ,. . .■. I . 'ii » il l;* Ml <(i:,tr' T'wi>^ t'A'^ jt)Uar\ .irul titt\ a*nts. Ilow many 

h.t. h.,' : A- h --in" 

SubjoctN ;^•^pn^i^iod m rfuce distp<t ways. Soiiic sul^iects made a literal (syn- 
tactic) trans!at:on nt the prt?hleins. In the example (|U<ued above, they arrived at 
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the equation 



f^.V = 250 + 25(7.YK 



Other subjects, apparentiy iu)ting that the value of the quarters must be greater 
than the value oi' the dimes, simply assigned the extra two and a half dollars to 
the other side ot' the equation. Their solution rpade sense* of the original 
problem, but did not represent an accurate translation of tlie problem statement, 
A tliird group of subjects objected that they found the problem contradictory. 
They could not reconcile their (accurate) ti^anslation of,the problem statement 
with their mterpretation of tlie physical reality of the situation. 

Tills experiment demonstrated a considerable variation among human subjects 
in their relative reliance upon syntactic and semantic cues in doing algebra word 
problems. It also shows that, when the subject's semantic knowledge is taken 
into account, many pri^blems have considerable redundancy.- Different under- 
standing processes may accomplish their task by making use of different parts of 
the redundant niformation. Hence, frcmi the fact of understanding, one cannot 
infer a unicjue program that brougiit about that understanding. 

Styles in Understanding 

In tiie complex tasks handled by professionals, only a small part of the task 
information comes, from explicit instructions. Tlie vast bulk of tliis information^ 
is retrieved from the professional's long-term memory, wliere training and 
experience have placed it. A [t;w studies have begun to disclose the nature of this 
professional knowledge, and how it is used in problem solving. Clarkson' f 1963) 
simulated the professional decision making tjf a bank trust officer, while the 
decision making ^f chess .masters has been studied by de Groot (1965, 1966), 
Newell and Simon ( 1972) and Chase and Simon (1973a, b). We will need many 
more such studies, over a whole rimge of professions, .to explore and characterize 
the variety tvf understanding processe'i^.used by professionals. ( 

Parallel to' the diflcrences among problem doinains are differences in ti\e 
strategies, or styles, that problem solvers may employ in seeking to understand' 
instructions. The success of a pa'rticular style may depend on its appropriatenei 
to the pn^hlom domains to which it is applied. For purposes of discussion, y/l 
may consjder a style that emphasizes abstraction processes, one that emphasizes re- 
trieval from semantic memojry, and one that emphasizes me taplior and' analog^j^. 

In the previous section, the first, two of these styles have already received some 
attention. We saw that success in understanding a puzzle-like problem depends 
on skall in abstracting arul m disregarding irrelevant semiintic interpretations of 
the problem vt)cahulary. On the otlier hand, we saw that more complex prob- 
lems are generally inscrutable without semantic Interpretation. The third style- 
that employing analogy and metaphor needs some additional discussion. 
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Sevt*r..il Mibjecfs. cuiiUi'iital with the Mfustcr Piuhlenu said, *''f his leniiiuls ine 
or" i\u' I'«\vei ol \hi\ n puzzle." The Tower Hanoi Is a pu/./le involving three 
poi'-> .itivi a riurnhoi <>{ disks o? JiUer'.»nt ^i/es that can be phiced in pyrannds on . 
the pegs. Disks can he moved, tuie at a tune, with the constraint that a larger 
disk may inner be piaanl iipon a sniaher one. The lower oi^ Hhnoi is, indeed, 
isiuntirphk: wrth [he MoHste» Pffiblem. Any legal move in the foimer eor- 
responds to a lei/al niove in the latter, where pegs are niterprcted as monsters, 
and disks as elobes (with 'Mariner'* and 'Nmaller''. inteiehanged). In principle, a 
inhject wh'> was familuu with the Tt)wer ot thmoi could, when he noticed its 
reNenif>Ltrue fu tho \I.»nskM l*ruhl«Mn, "undiMstaniT' the latter by mapping it in 
i>ne4oM»ne rasiut>n on rhe toimei. In lact» none ol the subjects who noticed the 
analo^jv succeeiled m carrymg out the mappuig. They all found i'i easier to 
ci !!\tract a new representation ol the Monster Pioblem, disregarding what they 
fiad »tii rtl al^'uit the snnilaiitv, 

Ihis is not to viv that there are not other' situations in which analogy could be 
n^e^l t«» uruier .tand a proMem, o\ th.at there are not other subjects who could 
carry i»nt su Ji a f^Kt|>pn}g. Nor can we yet explain why recognizing the similarity 
was not helphil in undcT iiaiulmg the Monster I^ti^blem. 

there exists at least one attilicial mtelligencc prograni that makes use of 
analogv ti» solve prohien)s. Kling (P^71) has c<Mistructed a theorem-proving 
{noi»r,un t[iat» e«int ronted with a new problem, searches its memory i'or theorems 
jneviousK proved that resemble the one 'oetore it. If it finds such a theortMTi,it 
retrieves the proi>t , and tries to construct a proof of the new theorem along the 
lines of the old prin>f- 

fhe central c.ijxibihtv required of an an a logy -using prograni is to be able to 
ftum Jlie analogv. Iliis means there nnist be some way to match elements of the 
ouc situation onto elements n\ the other ti) determine whether there is an 
iNoinorpln.^in, or at least a one-many mapping. Matching programs that wall do 
this over some interesting range ot situations have proved diiTieult to construct, 
altliouVli some progress has been made in this direction (MtK)re & Newell, 1974; 
Snnon, \'i^2). Analogi/mg, is prohably an important human technique for ^ 
mtder^taiidinu [>roblem instructions, but we know lelatively little about it from 
either a psychologieal ni an artificial intelligence standpoint, li is completely 
absent from the l^NDbRSTANL) program, 

Ihese ratliei ^.ketcfiv rtMuarks may serve to su^^gest some of the parameters of 
avie m und'M -.ivrndnm. I here is evidence, some of v/hieli we cited in an earlier 
vx'rinn, that there are huge vaiialions in s-tyle among individuals, and that 
individuals do not <ilways ernploy the understanding style that is most effective 
tt.r fhe -atuarioit IhM»»iv them The theory embodied in the prejiciu UNDER- 
SI \NI) {.nouraiti d'u-, jioi take these sfvle dllferences into account; the style of 
the pre^onr proeiam veiy much emphasizes afv;tiaction processes, makes only a 
liMle Use kii'^wlcd::'' in seniantii; inemntv. and is completely innocent of 
luetuph'^r a^l4.ana^ . * 
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UNDERSTANDING INSTRUCTIONS 
AND INSTRUCTION FOR UNDERSTANDING 



The remainder n{' this cliapter is CDncerned with the educational implications of 
what we have learned abt)Ut understanding instructions. These implications point 
"in two different directions. Fn the first platc/we should be able io use a theory 
of the understiinding process to imp.rtwe the art of writing instructions^ One way 
to reduce functional illiteracy is to reduce the complexity of the instructions 
which the ilhterate meets in his daily Hfe. A good theory of the understanding 
process should tell us what we liave to dt) in order h) accomplish this.- 

In the second place, we siiould be able to use a theory t)f the understanding, 
process to design educational pr()grams aimed at enhancing students' abilities to 
understand complex instructions. If we cannot move the nuSuntain, we may be 
able to move Mahomet. I et us look at each t)f these strategies in turn. 

Simplifying and Clarifying Instructions" ' " 

This is hardly a new t{)pic. A large part of the efft)rt devoted in schools to 
improving students' ct)mmiuucatiou skills is directed at helping them to write 
mt)re clearly and simply. There exists, therefore, a large body of lore, based on 
extensive practical experience, as to what constitutes clear writing. Is there 
anything that a theory o( the understanding process can add to this well- 
established educational practice? 

To answer that questi(m calls for a substantial research and development 
effort. One part of that effort might well be devoted h) understanding and 
rationalizing vvliat is now taught in courses tm writing. If the theory we have 
been iHitlining here has any validity, then it should explain why one form of 
expression is clearer and simpler than another. Since the research remains to be 
done, we can only hint here at the form the explanatitm might take. 

If one includes in instructions information that is not useful for interpreting 
the instructions, (hen the reader may he misled into unproductive or misleading 
analogies. We have seen that a vital part of the understanding process is to strip 
away the inessentials from the problem statement, and abstract out the elements 
from which the problem representation will be formed. Reducing the number of 
inessentials In he stripped should siniplify the prt)cess. 

The theory warns us that irrelevance of information is not to be confused with 
redundancy. While irrelevant information in prt)blem instructions may make it 
harder to disctwer what is relevant, redundant information -or at least informa- 
tion that appears redundunt to the writer- may actually help the reader to 
resi)lve ambiguities, Wliere a particular phrase or clause can be interpreted in 
more than one way, the consistency heuristic discussed earlier may be used to 
find another passage v^'here some -of the same language is used, and to seek a 
. common, consistent interpretation of both passages. Application of tliis strategy 
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requires tluf there be some redundancy between the twi) passages. In extolling 
the values brevity, manuals on good writing do not generally make explicit 
the disimctii)!! between ehminatmg irrelevancy and eliminating redundancy. 

I he tlietuy alerts us to the semantic informatit)n that is needed to 
interpret instiuctii)ns successfully, and suggests an approach toward systematic 
ideiUillcation oi that information by analysis of the problem structure. The 
instructions can then be teste<l tor completeness to see whether they contain 
the semantic information that the reader cannot be assumed to have already 
available, f or example, Bi)br'^)w's program for algebra wuird problems could not, 
if it were deprived of the tt)rmula,/) ~ RX T, solve rate prtiblems. Constructing 
an artiTicial intelligence program io perk)rm the task vvt)uld provide an iventory 
uf the semantic information required for perftirmance. Similarly, submitting a 
set i/f'task instructions io the lINni-RSTANI) pnigram wcuild reveal the semiui- 
tic iidnfm.ittun needed for understanding those instructions. 

Ihus. not only might theory illuminate the nature of clarity in writing, and 
ways i)l attaimrm it, but artificial intelligence programs, througli their further 
development, joidd be used to analyse the structure of particular classes of 
problem enviroimients, and to 'Mebug'' instructions. by identifying points of 
diftlculty ui them. 

Teachnu] the Skills of Understan(Jinq 

It is unreahstic U) think that we can make more than a dent in the problem of 
fur^ctionui illiteracy by siiiiplilying and t)therwise improving the quality of oral 
and written mstructrons. At the same time we seek to improve the performance 
of the speaker or writer, we must seek to increase the ability of the listener or 
reader to comprehend complex prose. On the basis of the theory of understand- 
ing set forth here, we can sketch out stirne plausible, but untested, ideas as to 
how thfs job miglit be tackled. . 

To the extent that unders(an<ling problem instructions involves semantic 
Kaowlodi.'i* about a problem domain, there is no suhstitite for having the 
requisite knowledge. A person cannot interpret algebra wtird problems unless he 
knows what such phrases as ''twice as many'' mean. Training in understimding 
problem instructions wrtiiiol teach him this: training in arithmetic or algebra 
might 

Wliere soman! ic infi>rmatn)n is involved, learning, to understand problem in- 
structions cannot be separated from learning the subject matter of the problems. 
I'o ilie extent that functional illiteracy stems from lack of such knowledge, no 
amount ot' traiiumz in Ikjw to read or listen will remove it. 

But there is iit) reason to suppose tfiat all inadequacies in interpreting problem 
instructions stem from deficiencies in sub)ect>matter knowledge, in the example 
o\ the Monster Problem, we saw that some subjects failed to arrive , at a suitable 
problem representation, not because they lacked information, but because they 
draggevl m irrelevant information instead i^f abstracting out the essential problem 
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elements. Their diH'iciijties might have been reduced by appropriate training in 
{he skills of interpreting instructions. 

A first topic of instruction nuglit be stylos ot* interpretation. An awareness 
cuuld he deveKijK'd o{ tlie need to select a style of attack appropriate to the 
problem dtjmain. audi practice cimld be given in changing style in response to 
cues imbedded in the jhrobleni instructions. 



A second U^pic oj 



abstract it ui. Practice 



u»^truetIon might be the abstractive style itself. Tlie 



UND^RSI AND program provides a framework ft>r attacking instructions by 



could be given in identitying important sets of objects 



mentioned in the p i)bleni instructioiis. identifying relations, ctinstructing a 
representation of the silihition, ulcntifying the operators and condititins. ^ 

A third t(^pic of in: tiuction might be trauiing in tlie style that maximizes the 
use of semantic cues aiid aiialogV; At the moment, we have little to suggest 
about the .pccille^ nf tl»)mg this. 

A lnurth rn[Mc oi instruvtjDn nught be the skills t)f obtaining feedback from 
the m^tiuction givtu -n ironi .the task environment. Practice could be given in 
claritymg task uistPK tions f^y. asking c|uestit)ns, by making st^lution attempts to 
identify arnbiguitu-s. by searching fur and exploiting redundancies in the insfruc- 
tinns themselves. The tield ot computer programming niiglit be a useful ;md 
apprDpruite tliunam within which to practice such skills. Programming problems 
can be proposed at any desired level of difficulty and clarity. Programming 
nuuiuais arc .inexhaustihfc sources ol unclear (and occasionally clear) problem 
instructions. I'he computer itself provitles a real-world environment in which 
understanding can bo tested and feedback obtained- Tiie idea of using cpmpiifer 
programming as a domain lor teaching the skills tif understanding instructions is 
not unrelated to the proposal and experiments t)f Papert iind Miiisky (see Pape^t. 
P)71), who use programming as a doniain ft)r teacliing general problem-solving 
skills. (See also Norman. Cientiier. & Stevens. Chapter this volume). 

No di)iibt these are only a fraction of the possibilities for specific instructional 
plans tor raising the skills of understanding instructions. As we acquire more 
adequate theories i)f the understaruling process, oiir abilities to ct)ristruct effec- 
tive tr^umni' pr<»v:od;ues sluiuhl increase. In tins chapter we have tried only to 
suggest sttrno geneMl \nu:\ of attack on the prt>bleai; we are under no illusion that 
we have sv*Ived it. It is well worth solving, because it is deeply implicated in the 
extent and^sovejitv of ftiiKtional illiteracy in our, society. 

.. ; 
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" ' \ 

• Education has typically dealt with the problem of understanding only in terms of 
^the mechanics of reading, that is in terms of learning which words go with which 
printed strings of letters. The two chapters by Just arid Carpenter, Chapter 13, and 
by Simon and Hayes, Chapter 14, deal with the problem of understanding in 
two quite different ways, both distinct from the mechanics of reading. If Simon 
and Hayes are correct that tlie difficulties adults have in reading are deeper than 
tlie mechanical level, then surely it would be worthwhile to teach people 
understanding skills as well as reading skills. So if it \% p>ossible to analyze 
understanding in deeper terms than the mechanics of reading, the implications 
for education should be important. 

Just and Carpenter deal with the problem of understanding principally at the 
level of the individual sentence. The data they present to support their model of 
sentence processing is very convincing. Underlying their"'model is a comparison 
or matching process, which , they treat as a simple, unitary step that can be 

M repeated different numbers of times. I suspect their comparison model is 
basically correct and I have argued else^Vhere (Collins & Quillian, 1972) that 
such a comparison .process pervades all of human language processing. 

In the tasks Just and Carpenter hav^e used, the comparison process would be 
quite simple, and assigning if a fixed duration as they do makes sense. But the 
reader should not be misled into thinking that it is always a simple process or 
that it has a fixed duration in general. This could" be shown even in the kinds of 
tasks Just and Carpenter have been using. For example, consider the task where 
a sentence such as "The dots are red" is compared agaitist a picture of red dots. 
One manipulation that should affect the duration of the comparison process is 
the perceptual similarity of the color in the sentence and. in the picture. If the 
dots are •red,ofor example, sentences such as "The dots are purple'' or "The dots 
are pink" should take longer to reject than "The dots are yellow " This kind of 
example can be extended into the semantic domain. If a picture has red dots; « 
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veritying a sentence like "The circles are red" or "The squares are red" involves 
deciding whether dots can be circles or squares. Similarly if the question is 
whether "The dots are crimson/' "The dots are maroon," or "The dots are 
colored," this involves deciding whether crimson, or maroon, -or colored can be 
the same as red. The point is simply that the comparison process itself can be 
complex, involving subprocesses of different durations. Just and Carpenter's 
fme-grain analysis of processing may be extendable to analysis of the comparison 
process itself. 

There is one other question I might address with respect to, Just and Car- 
penter's chapter: that is, are they dealing with the jeal problems of under- 
standing? The answer is, I think, that they are dealing with some of them. But 
there are other even more difficult problems that they have avoided. The 
assumptions of their verification studies is that the relevant knowledge is directly 
stored as a single entity. Jn their studies this is so, because they've made it so, 
but in real life it is usually not the case. Often answers must be inferred from 
several pieces of knowledge scattered about in memory. Even when Just and 
Carpenter analyze reading comprehensiori tests, they have not tried to deal with 
how the reader relates the inft)rmation in a paragraph to his various kinds of 
knowledge about the world. These are probelms that are probably beyond the 
scope of the fine-grained analysis which Just and Carpenter using. But they 
are susceptible to the kind of analysis that Simon and Hade's are attempting in 
their chapter. Simon and Hayes analyze what it me^afis to understand the 
statement of a problem. Their discussion of ill-structured and well-structured 
problems directly ijddresses the issue of how mupji- knowledge aTeader brings to 
bear in understanding a problfjm. It is perhgpr6ne-of the :giost important points 
in the chapter. As Simon and Hayes point out, a problem is ill structured to the 
degree a person needs to use knowledge beyond that which is in the sti:*'?ment of 
the problem, either to underst^md or solve it. The distinguishing feature of 
problems like the monster problem they have been working with is that relatively 
little special knowledge is needed to understand the problem It is a well- 
structured problem. 

Is life like a monster problem? Again I want to be wishy-washy :md say yes 
and no. I think people spend much of their time problem solving, often at a 
subconscious level. For example, problem solving turns, up when people try to 
answer . questions to which -.they do not have prestored answers (Collins, War- 
nock, Aiello, & Miller, 1^)75). Therefore, one of the aims of education should be 
to teach people how to understand and solve problems as effectively as possible. 
This attitude refiects the views of Simon and Hayes and Papert (1972) of 
education. But there is a difference between the two views. Papert tends to 
discount the" teaching of factual knowledge as a legitimate goal of education, 
wherea^s Sinlon and Hayes' view stresses the importance of knowledge for dealing 
with ill-structured problems. It turns out that most of life's problems are ill 
structured, and so acquiring and using factual knowledge is crucial to under- 
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standing most problems. It is because of this that Ufe is not like a monster 
problem. 

Consider the kinds of real-world difficulties in understanding that Simon and 
Hayes cite at the beginning of their chapter. People cannot understand instruc- 
tions on soup cans because they do not Have enougli knowledge about cooking 
of the kind qne acquires from practice, or knowledge about the basic terms in 

■ cooking like "simmer" or "colander," or knowledge about the structure of 
recipe instructions that one acquires from reading recipes. Alternatively, con- 
sider the problem of understanding traffic tickets,' There the difficulty in 
understanding may derive from the use of legal language and concepts. In such 
cases understanding may involve knowing what to ignore, as Simon and Hayes 
point out can be important in monster problems. But knowing what to ignore 
here requires a primitive knowledge of law 

These examples emphasize the fact that monster problems probably are a good 
place to approach the problem^ of understanding, because the; semantic knowl- 
edge needed to understand them is relatively limited. But the difficulties in 
understanding soup-can instructions and traffic tickets will not be solved by a 
de(^. analysis of monster problems, because the difficulties arise in having 
enough knowledge about the world and using it appropriately to fill in the 
information that the text assumes. 

The important conclusion from all this is that there is no easy 'way to educate 
people to understand. Because life is full of ill-structured problems of the kind 
that soup cans and traffic tickets present, we need to have a huge amount of 
world knowledge, together with the kind of understanding and problem-solving 
skills that Simon and Hayes or Papert advocate. Papert's viewpoint should 
probably be stressed, because school teachers have only tried to impart world 
knowledge and not these other skills. By deemphasizing the teacliing of world 
knowledge, educators may be induced to strike a more even balance. But in the 
end there is no way to teach people to understand soup-can instructions without 

, teaching them a lot of tilings about cooking. 
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I am in essential agreement with Collins (Chapter 15, tliis volume) thaf Chapter 
13 by Just and Carpenter is a fine piece of work on a very difficult problem. 
Therefore, having no major criticism to make, I address my comments to the 
broader question of the relevance of research such as theirs to other problem 
areas of psychology. I would like to describe some of my applied research 
experience in apliLLSia and art instruction in order tq demonstrate how a consis- 
tent underlying peoretical orientation has lead us to applied instructional 
programs in two vfidely diverse areas. j 

; ■ i 

■/ • 

;/ Tf^EATMENT OF APHASIA \ 

■I f 

The most impr^^ssive aspect of the Just and Carpenter work is the fact that a very | 
simple model icems to account for processing latencies in a variety of linguistic | 
situations. I must admit that 1 smarted a little upon first reading their contribu- 
tion because 1 saw that they had succeeded in finding a reasonably sfmple 
linguistic processing model for various sentential trajisforms where attempts at 
Minnesota had met with much less success fClifton, Kurcz. & Jenkins, 1965; 
CHfton &Odom, 1966; Walls, 1968). 

In 1966, Terry Halwes and 1 developed a partial transformational grammar for 
English that produced the structural descriptions for elliptical sentences. In a^ 
sense, our system constituted an early attempt to develop a "question-answer" 
model that might ultimately be used as part of natural language or conversa- 
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tiontil computer program. An explanation is in order since the experimentation 
motivated to test tliis nlbdel was not unlike tliat done by Just and Carpenter. My 
primary purpose is to suggest some ways in wliicli basic psycliolinguistic research 
in general may be iVuitfully applied to the study and treatment of communica- 
tion, such disorders as aphasia, in which normal language processes have some- 
how become dysfunctional. 

Even though our success in applying psycliolinguistic techniques to the study 
of aphasia may have been^'siight, it may encourage such other researchers as Just 
and Carpenter to apply their more adequate techniques to the study of such 
langufige disorders. My main point is that the treatment of such disorders 
necessarily involves assuinptit)n regarding the nature of instruction, or, more 
precisely, ^^'instruction. Speech therapy is a form of reinstruction o'f people with 
pespect to ii skill once possessed but now lost, and as such is indeed a problem 
for instruciional psychologists. For only to the extent that instruction is under- 
sti-iod can techniques for reinstruction realistically hope to improve. Thus, the 
topic examined in tiiis volume, cognition and instruction, is vitally important to 
nearly all forms of clinical therapy in which restoration of a lost skill is the goal. 

As is so often the case in basic research, Terry Halvves and [ did not even 
consider the potential relevance of our wtirk to instruction or reinstruction when 
we were developing our grammar of elliptical sentences. Perhaps we should have, 
but we did not. By relating our experience I hope that other researchers may be 
made more circumspect regarding the relevance of their work to serious applied 
problems. I believe that volumes such as this one surely help us all take a much 
needed .step in that direction. 

Fhilwes and 1 borrowed from the transformational grammars that were tlien 
under development by Chomsky (1^)65) and Lees ( I960). Ouf grammar differed 
from theirs, however, in that it reputed to capture the relationship of a 
declarative sentence to all the WH questions , that might be asked about the 
content of the sentence as well as all the elliptical answers that might be given. 
For i^istance, consider the sentence, The little zebra nimbly jumped over the 
stream. Restricting ourselves to just the WH questions, some of the questions 
that might be asked by someone who failed to process the sentence successfully 
when first presented for whatever reasons (distracted, partially deaf, retarded, a. 
nonnative speaker, etc.), may ask: (t'w/ did? Did what? Which Zebra? Jumped 
where'.^ Over what?' How'^ etc. The corresponding elliptical responses to these 
''ellipsi/ing'' questions migiu be offered: The zebra. Jumped. The little (me. Over 
the stream Ximbly. Our grammar showed that the same transformations used to 
derive a , whole ijentence could tagjcertain sentential constituents in such a 
manner that either of two kinds of transformations migiit be applied to the deep 
structure forms, an ellipsizing question or a correct elliptical answer to that 
question. In other words, an ^'erasure*' transformation applied in a compU- 
mentary fashion to a given sentence to produce either a desired question or a 
desired answer. Our theory established what we called the transformational 
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relationship of grammatical complimentarity between ellipslzing questions aiid 
the elliptical answers they evoked. All tliis was achieved with a minimal modifi- 
cation to Chomsky's (1965) version of tlie transformational grammar oPEnglish 
and without destroying any of the desirable properties that such a gramm.u must 
have if it is to contribute to a theory of language comprehension. 

To initially test our grammar we showed that it could generate over 98% of all 
the elliptical sentences given by a large number of adult normal subjects when 
asked the total set of possible ellipsizing questions about a wide variety of 
sentences of various lengths and degrees of syntactic complexity. Later, given 
the success of this iniiial test of our model, we attempted to determine if a 
similar technique might not shed light on the problem of how linguistic knowl- 
edge is represented. More specifically, we wanted to determine the extent to 
which our knowledge of sentences was represented in a form possessing some 
degree of abstract similarity to their transformational description. By using the 
ellipsizing question as a probe, we hoped to show that the latency of producing 
an appropriate elliptical answer was proportional to the number of operations 
used in its derivation by the grammar. If this proved to be the case then, 
following a line of argument made popular by Chomsky, our modified transfor- 
mational grammar (mostly Chomsky's and Lee's, that is) woul'd be shown tp be a 
valid model of how linguistic knowledge is represented. 

To this end, with Virginia Walls (1968) we developed what we called the 
ellipsis production task (EPT), which is carried out in the following way, A 
subject i§ given a deck of cards with a single sentence on each card. The subject 
memorizes the sentence on a given card turned up in front of her. The subject 
then turns the card face down and the experimenter asks an ellipsizing question 
about the sentence just memorized wliich she is* to answer immediately, A voice 
key is tripped by the offset of the experimenter's voiced question and again by 
the onset of the subject's vocal response. Hence, a measurement is taken of the 
time required for the subject to process the question. 

Our primary assu'mption was that questions probing more complex answers 
embedded deepest in the sentence would require the most time to process. In 
contrast, elliptical answers whose derivations were simpler should take less 
processing time to retrieve. Rouglily, our hypotheses were borne out according 
to a simple count of the number of rules needed to derive the elliptical response 
as predicted by our transformational grammar, for elliptical sentences. Unfor- 
tunately, the derivational "distance" metric selected predicted less and less well, 
the more complicated the predicted derivation. It is here that the Just-Carpenter 
model seems superior to our earlier attempt to measure' linguistic processing 
times. 

Later, while working at the Aphasia Clinic at the Minneapolis Veteran's 
Administration Hospital with the great aphasiologist, Hildred Schuell, William 
Brewer and I attempted with some success to apply the fePT and other psycho- 
linguistic techniques to the study of the aphasic cormnunication disorder. 
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However, owing to the untimely death of Hildred SchucH, the re'^earch project 
was never fully completed. Some tentative results, however, can be culled from 
these efforts. 

As is' well known, it is veiy difficult to get reliable measures of linguistic 
processing latencies from aphasic patien-ts because the time it takes them to 
produce any gi'Ven utterance at any given time is highly erratic, thus giving an error 
term that renders any statistic virtually useless. However, their pattern of errors 
on linguistic performance does seem quite reliable over tasks. Roughly, we found 
that the errors produced by adult aphasic patients in either producing sentences 
from given words, repeating sentences presented visually or orally, or in answer- 
ing questions about sentences available in front of them (a modified version of 
the HPT) were correlated with the syntactic complexity of the sentence or the 
deriviational relationships among sentences-questions-answers. This suggests 
that a correlation should exist between the latency measures exJiibj^ted by 
normal native speakers in processing sentences and the error measures exhibited 

* by aphasic patients on similar tasks (Schuell, Shaw, & Brewer, 1969; Sefer & 
Shaw J 972). 

The attempt to apply psycholinguistic and cognitive principles to the study, 
diagnosis, prognosis, and treatment of aphasic patients forced us to rethink 
, seriously what we believe to be the nature of normal cognition and the role it 
plays in normal communication. In SchuelVs Aphasia in Adults (Jenkins, 
Jimine/.-Pabon. Shaw, & Sefer, 1975), we present a functional schema for 
cognition that organizes the contribution of all the various psychological com- 
ponents We believe necessary to normal communication. Our theory of aphasia 
and other communication disorders provides a characterization of each type of 
communication disorder in terms of the dysfunctional relationships or inter- 
actions among these necessary components as a result of trauma to the system. 
In other words, in this book we have made a serious effort to define the norm 
from which aphasia and other disorders deviate and to precisely characterize that 
deviation. I'urthermore. it is with respect to diis cognitive approach to com- 
munication and conmuinication disorders that 1 feel the Just-Carpenter model, 
as well as the models in the chapters by Simon and Hayes and by Shaw and 
Wilson have particuhu relevance. In isolation one may indeed question their 

• relevance to current instruction^ problems in either the clinical or classroom 
'Settitig. However, when taken together, their potential relevance to the realiza- 
tion of a general cognitive model for communication— sometliing that is obvi- 
ously indispensable to the development of a true science of instructional design- 
becomes obvious to even the most applied psychologist. 

The potential relevance of basic research in cognitive psychology to applied 
problems i's illustrated in the case of the generative approach to conceptual 
kno.vledge and the techniques of stimulative' therapy developed by Schuell. 
Therapy can be considered a form of instruction when the latter concept is as 
broadly construed as I feel it should'be. The stimulative method of construction 

O . ■ 
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whether applied in a classroom program to teach or improve language facility of 
normal speakers, or in a clinical program to treat aphasics, is based upon a sound 
pedagogical principle, namely, the principle that, in general, one should stimu- 
late rather than correct. The idea Schuell repeatedly proved in her clinic is that 
defective responses tend to disappear automatically as language functions in- 
crease. Thus, the time of the clinician, like that of the teacher, is better spent in 
stimulating the proper use of all language modalities rather than in trying to 
force patients to modify erroneous responses made sporadically along the way. 

The success of the stimulative approach depends upon the existence of what 
Wilson and I have termed the "generative cognitive capacity" for the following 
reasons. Language is learned originally in childhood from experience with a set 
of linguistic structures that is much smaller and less systematic than the dynamic 
whole finally achieved by adulthood. The clinician, no less than the teacher,, 
must discover what language functions (vocabulary., syntactic forms, sound 
patterns, etc.) the patient or student has, and use these as the material by which 
to stimulate or restimulate, as the case may be, the cognitive processes and 
physiological synergisms required for normal language processing. FOr instance, 
. the residual language remaining for most adult aphasic patients will be from that 
area of knowledge- most closely related to the patient's job and home environ- 
ments. The words, concepts, and sentential structures that are most salient in 
those subcultural contexts will probably contribute the greatest amount to the 
patient's residual language. If the patient is a farmer, then his residual language is 
most likely to be about farming; if a doctor, it is about the practice of medicine; 
if a lawyer, it is about the practice of law, and so forth. 

Given both the logical necessity and the empirical tWdence for the existence of 
a generative cognitive capacity as discussed earlier (Shaw & Wilson, Chapter 10 
of this volume), what could be more natural than stimulative therapy? Here 
simple exemplary sentences constructed from the patient's residual vocabulary 
are given to him for practice. The materials should not be so easy as to require 
no effort nor so difficult as'to be frustrating. Rather they should be so suited to 
the patient at a given time as to allow for a moderate degree of success. Thus, in 
this way the patient is allowed to build from success to success at gradually 
increasing levels of linguistic complexity. Obviously, then what is sorely needed, 
if such therapy is to be successful, is as precise a metric as possible for measuring 
the difficulty of the material. It is here that the demand for techniques for 
measuring linguistic proceping latencies and linguistic processing errors converge 
with the need for a teclinique to select the set of exemplars to be practiced. 

The sentences constructed froni the residu'al vocabulary of an aphasic patient 
and given to liim for practice must be selected to be both exemplary and of 
adequate difficulty, if they are to stimulate the traumatically deranged cognitive 
system to reequilibrate along the same lines as tlie functional organization 
existing before the trauma. Since language is itself a generative system built up 
originally from practice with perceiving and producing exemplars, restimulation 
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during the course of tlicrapy presumably suca^eds only if the cognitive system 
retains sufllcient generative capacity to become functionally restructured by 
generalizing from the exempln^rs experienced." 

Thus, the generative model for concept learning als^l^provides an explanation 
for why stimulative therapy should work at all. Moreover, this model provides a 
new, more dynamic theory to supplant the traditional, essentially static theory 
offered by stimulus-response psyqlio logy for botli positive transfer and so-called 
"stinuilus generalization." The wedding of this generative model with stimulative 
therapy is testimony to the proposition that a symbiotic relationship cah exist 
between pure and applied psychology. 



1 beliQve perception is the epigenetic fount of all knowledge gathering activities. 
By this I n^an that all concepts ultimately have their developmental origins in"" 
the process of perceptual abstraction of invariant information from events-what 
J. J. Gibson has called the pickup of invariant information over time. But since 
this view probably runs counter to the more constructivistic account of knowl- 
edge championed by most contributors to this volume, perhaps 1 should explain 
what Wilson and 1, following a Gibsonian line of argument, believe to be the 
nature of the epigenetic process by which abstract concepts are specified by ' 
perceptual experiences/ After doing so, [ v^ll relate this view to some of those 
di.scussed in thisvohime. 

Our basic assumption, what m.ght be called the event perception hypothesis, is 
that all conceptual knowledge ultimately has its origins in the affonlance ' 
structure of events. By the affordance structure of events (S^iiaw, Mchi tyre, &' ^ 
Mace, 1074) we mean the detectable invarian'^t inVormation determined by events 
'that specifies the true properties of its event source that may contribute' to an 
animaPs or pcrson\s adapiative behavior. How this may be will be explored in a 
moment. 

This hypothesis suggests that all concepts, even the most abstract ones, 
ultimately refer to events when the concept of event i,s broadly c oust rue d,-For 
in.stance, thcoconcept.s of mnqing. smiling, or eating may be exemplified by 
events 'involving running, smiling, and eating. But what of more abstract con- 
cepts sucii as love, justice, or truth'* We also assume that these concepts 
ultimately derive from the perceived affordance structure of events, namely, that 
the concept of love is derived from perceived instances of justice from 

perceived instances where justice has been properly administered, and truth from 
perceived instances where something believed to be the case wa.s in fact shown to 
be! the case. This is not to argue, however, that each concept understood by a 
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particular individual must be learned by that individual from experience with 
actual events; for surely we often learn vicariously from verbal descriptions or 
surrogate forms (movies, pictures, etc.), of other people's experience, as well as 
from 'descriptions or representations of fictitious or- inferred entities (e.g., 
stories, plays, models, or proofs). 

. In short, much, of our conceptual knowledge of the world is sopially derived 
from instruction by others or instructional materials. A word of caution: The 
event perception hypothesis should not be confused with the view of radical 
empiricism which asserts that perception is based on elementaristic structures 
such as sense impressions, sensations or simple sense data. Under this view 
abstract concepts are built up by a process of association. By contrast, the view 
we are offering does not assume a single simple level of analysis is sufficient to 
characterize the relevant information liberated by events, nor does it assume an 
associative mechanism for compounding complex concepts out of simpler ones. 
The cognitive capacity we believe to be at work is generative, rather than 
associative, possessing considerably more structure (probably resembling that of 
a mathematical group) than that offered by associative principles. Indeed, tlie 
only premise our generative theory of event conceptualization has in common 
with radical empiricism is affirmation of the postulate of critical realism, 
namely, that there exists a real objective world about which we may have 
veridical knowledge. In addition, our theory of the knowing agent is an active 
one where tliat of the empiricist's is quite passive. Now let me relate our 
o generative theory of conceptual knowledge to some of the other views presented 
in this volume. 

Norman, Centner, and Stevens (Chapter 9, tliis volume) suggest a network 
description of the concepts, not necessarily linguistic, involved in money chang- 
ing, say as in the case of making purchases in a grocery store. Here objects, 
bearing specific relations to one another, are being transformed; that is, money 
and goods are being exchanged in itccordance with certain economic principles 
agd. customs governing behavior in the market place. Children, according to 
Norman, eventually learn this process by experiencing those events in which 
growimps ex,change money for goods (see Centner, 1975). He begins his- 
network analysis, of this knowledge by assuming tliat certain nodes and relations 
exist among" them, but his model does not yet account for how such- primitive 
nodes and relations are derived from experience ."The generative model offered 
by Wilson and me seems to supply the missing cognitive component by which 
such nodes and relations are originally specified by events. 

Such a generative perceptual component is no less necessary to round out 
Greene's (Chapter 7, tliis volume) network approach. Moreover, Hyman's (Chap- 
ter 8, this volume) impression formation task seems to me to imply the existence 
of such a generative cognitive capacity as does our own experimentation. 
Moreover, it seems to me that the monster-globe-passing problem addressed by 
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the Simon-Hayes .(Chapter 14, this volume) problem-solving model with the 
^ "change" operator can be construed as an attempt to study the affordance 
structure of a "monster-globe-passing" event. 



KNOWLEDGE ORIGINS VERSUS 
KNOWLEDGE REPRESENTATIONS 

Before closing, I would Hke to emphasize the distinction between the representa- 
tion of knowledge and the origin of knowledge. The two are not the same. The 
origin or epigenesis of knowledge has to do with the primitives that go into the 
representation, the nodes and relations, the schemata. My suggestion is that thS 
principles revealed by the study of how event concepts arise from the perceptual 
information specifying, the events may provide an inroad into the fundamental 
problem of how knowledge should^ be^ represented. For if we attempt to 
represent knowledge in terms of networks or other models by merely selecting a 
priori labels for our concept nodes and relations, then we may end up with_a 
logically possible but arbitrary schematic representation of knowledge that has 
little to do with how the concepts actually arose. Our knowledge of the world is 
interfaced by direct perceptual experience^ of events and, therefore, the percep- 
tual processes involved can only be ignored at our peril. For this reason the role 
of perception seems to me to have been greatly underemphasized at this 
conference. There ^eems to be a tendency toward too much theoretical depen- 
dence on secondary processes such as language. 

Let us recognize the fact that much of our knowledge is either tacit or purely 
nonverbal, neither being able to assume a linguistic form. For instance, try to 
give an adequate verbal description of nearly any object (e^g., flie face of a friend 
or relative), any act (e.g., tying your shoelace, riding a bicycle) or any other 
non^rivial event. We are never able to verbalize more than a small tip of the 
iceberg of what we can recognize or recall about a famihar object, act or event. 
Instruction, therefore, should be aimed at this nonverbal aspect of knowledge 
gathering activiries as well. Learning to read is of course an indispensable social 
skill but so is learning to "see" in the broadest sense of the term. 

AN APPLICATION TO ART INSTRUCTION 

As argued eariier, this view that perception is itself a mode of cognifion is in 
no way antagonistic to the purposes of tliis conference, nor is it as irrelevant as it 
may at first seem. Let me describe a project, on wliich I have been a consultant, 
that uses perceptual principles *as an integral part of its instructional design. 

In 1973 the Minneapolis Institute, of Art requested help from the Center for 
Research in Human Learning at Minnesota. P. Salapatek, A.Jonas H. Pick, and 
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I, as perceptual psychologists, were asked to help in theNdevelopment of an art 
exhibit for children to celebrate tlie opening of the new art educational center 
attached to the museum. Our task, in cooperation with artists and art historians, 
was to develop a sequence of modular displays aimed at the explanation of how 
paintings incorporate perceptual information that specifies spatial layout, shape 
of objects, color contrast, and so forth. Consequently, we have developed a set 
. of portable moaular displays in which each is designed to present schematic buf 
working models o'f situations demonstrating various salient forms of perceptual 
information. For instance, one display allows children to see what happens to 
the apparent size of an object wlen moved across a texture. gradient toward a 
simulated horizon of vanishing points. By this display we hope 'to lei the 
children learn about the laws of linear perspective through dynamic manipula- 
tions wliich provide exemplars for the relevant concepts. 

Next to the 4isplay is a large print of a painting in the museum that cjearly 
utilizes the same perceptual principles. In addition, between the picture and the 
display is a schematic drawing presenting in outline jusi those portions of the 
painting relevant to the principles demonstrated in the display itself. In other 
words, die relationship between the painting and the display is clarified by a 
simpler, intermediate step that omits confusing or irrelevant detail. In another 
display module we illustrate in a similar fashion how shading on objects or their 
cast shadows provide 'information for their shape or distance from other sur- 
faces, respectively. Again the abstract principles are illustrated in a higli-fidelity 
copy of an actual painting in the museum interfaced conceptually to the visual 
display by a sclieniatic diagram outlining the relevant parts of the picture. « 

After studying the dozen or so visual displays, the children are guided through' 
the museum proper to rooms where the pictures used in the displays are actually 
hung. Our ul^mate-goal is to determine the time that the children spend looking 
at the pictures represented in the displays and, more importantly, the time spent, 
looking at otlier pictures not seen before that clearly portray thfe same type of 

0 

perceptual information presented in the display modules. We hope that such 
measures indicate that children show more interest in those paintings expressing 
tlie same information studied in the displays tlian in those comparable paintings 
not relevant to principles demonstrated in the visual displays. . 

In summary, it is our intention to interest children in the perceptual problems 
solved by great painters in theii works, to provide them with a kind of problem 
Solving orientation to tlie museum rather than to just turn them loose in the 
galleries to be arbitrarily bombarded by a confusing welter of information. By 
.•giving them the knowledge of the appropriate perceptujil concepts beforehand, it 
is our belief that ^they will be encouraged to see the paintings rather than just 
look at them.' It is interesting to speculate on how a really weO-con trolled 
experirnent of this type niigh' provide challeuging data relevant to the evaluation 
of many of the cognitive models presented in this volume. 
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Part IV 

GENERAL COMMENTS 



You have just spoken in praise of me," 
siiid Socrates. **and now it is my turn to 
spuak in praise oFnly right-hand neighbor. If 
Agathon sits ncx to you, it will fjdl to him 
to speak in praise of me all over again, 
instead of niy speaking in praise of him. Let 
it be aS I propose, my good friend, and , 
don't grudge tlie lad his tribute of praise 
from me, especially as I have strong desire 
to eulogize him. . . , 

Agathon got up, intending to move to the 
place on the oth^^ side of Soerates. But at 
tliaj moment a crowd of revellers came to 
tlie dobVi and fmding it left open by some- 
body who had just gone out, made theh: 
way 'into tlie dining-room and installed, 
themselves there. There was a general up- 
roar, all order was abolished, and deep 
drinking became the rule [Plato: The Sym- 
pomnn J . 
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In reacting to this volume, 1 shall address three points: the appUcation of theory 
to practice; the nature of a prescriptive science of instruction and its compo- 
nents; andvin the context of these components, specific remarks based on some 
of the chapters that have been presented. 

THE APPLICATION OF THEORY TO PRACTICE 

Strong applications of science to practice generally are characterized by some 
linking body of knowledge and procedure-some sort of a linking science 
•between a descriptive explanatory^ science and application by professionals. 
There is rarely a direct relationship between descriptive science and professional 
woti:, Attempts at direct application without building a^'Iinking science either 
. tend to fade away or are subject to sporadic flashes of interest by particular 
scientists who happen to become interested in some applied problems at the 
moment. In either case, no substantial structure is built up into which rules or 
hypotheses for professional application ,can be placed." In psychology, an 
example is the field of programmed instruction where professional societies were 
established which were uninhabited, for the most part, by people who main- 
tained a scientific interest in learning theory, and who could nurture the 
development efforts and new attempts in programmed instruction. The field 
spun off by itself with its own body of rules and declined in impact because it 
was not yet ready to stand by itself. The danger is that a body 'of practice is 
picked up, is deintellectualized in the sense of becoming separated from the 
theory that generated it, and is earned, out in a rote, l)y-the-numbers fasliion. 
Some of the Chapters in tliis volume make me wonder about such a danger. We 
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may need to guard against enciniragin[; pinential practitioners from immediately 
establisiung a Soeiety for Cognitive Research on tlie Advancement of Pedagogy 
(SCRAP)^ tiiat is not nurtured by tiie active involvement of people like those 
represented here. Fstahlishment of SCRAP should not happen for some time to 
come. l\n the present, what is required are sustained attempts at instruction, 
constantly working between science and practical prt)blems. This interaction by 
someone who has both aims in mind, who is both a trained scientist and who 
takes seriously a practical problem, is the way in which a linking science 
generally is developed. Only after the linking science evolves in some form is it 
possible for a prt>fessional field to grow and for jxM)ple to work only in the 
linking science »itself. The game for us^at this time is lO take :m honest interest in 
instructional problems, to continue our interest In a science of cognitive psychol- 
ogy, and to play between tlie two until this linking structure develops. Simply 
turmng exciting fintlings over io someone with :ui applied bent or turning some 
• interesting procedures over to teachers to use will not do the trick. 

It is t^f interest to note that in 1899, in a presidential address before the 
American Kv chological .\s.sociati(Mi. John Dewey (1900) expressed concern 
about developing a linking science between psychological theory and practical 
work: 

"t>o wc not la\ A special Unkiiij^ SL-iciicc everywhere else between tli.^ theory and 
praetiial work? We have enizincerinj^ between physics iuul tJie practie;il workingnien in 
the mills; we have a scientille nieilieine between tlie natural science and the physician." 
Tho senUMKes sut>!est. in an almost startiint: way, that the real essence of the problem is 
loutul h an or^auic connection between the' two extreme terms between the dieorist 
and the practical worker through the medium of the linkinj? science, Tlie decisive 
matter is the extent to which the ideas of the theorist actually project themselves, 
ihrouiMi tlie kind t.iiKos i-f die middleman, mto the conscii)Usness of the practitioner. It 
is the participation by the practical man in the theory, dirou'gli the agency of the linking^ 
science, that determiijes ai once the et'fectiveiiess of the work done, and the moral' 
treediMii and personal development of the one engaged in it. 

... [If Hi't the teadicr is ciJUipcliedj to resort to i^urcly .irbitrary measures, to fall back * 
upon mere rtnitine lr,iiUtions ot school teaching, or to lly to the latest tad of pedagogi- 
uil du'orists dx' latest panacea peddled out in school journals or teacliers' institutes- 
lUst as the old physician relied upi>n his mai:ic formula (pp, 1 HK-ll.^]. 

A linking science is essentially a science t)f design. It is a prescriptive, norma- " 
live science, -and not the'kind of enterprise that most of the people in .this 
volume, who have been working in explanatory descriptive science, have been up 

^ to. The characteristics. ()f a science of design have been carefully discussed by 
flerbert Simon (1969), and f'need not get into those details here. The distinction 
between a prescriptive science of design and an explanatory descriptive science is 
maile clearly by Shiton, ami work in a prescriptive science mode has been 

' exemplified in the special limited case of stochastic models of learning in 

' We have the editor to lli.mk for this acronym. , 
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Atkinson*s Chapter 4. In general, a prescriptive science provides a schema for the 
professional in a field and for developers of applications who, provide the 
professional with tools, techniques, and instrumentation for professional work. 
Concepts and ideas are not directly dumped onto the teacher or the college of 
education. A design science leads to the development of instrumentation ^or the 
teacher and also for the student insofar as the student becomes his or her own 
teacher. Talk about direct application by descriptive scientists can be a lot of 
hand waving unless serious development of a prescriptive linking science takes 
place. It is a very difficult task at the moment because most cognitive psychol- 
ogists are descriptive scientists by training, and -very few of them have the 
temperament to work at a prescriptive science while tliey do their "Veal" science.. 

COMPONENTS OF A PSYCHOLOGY 
OF INSTRUCTION 

Consider now some possible components of a prescriptive science of instruc- 
tional psychology, but first let me describe in very general terms the kind of 
individual cognitive competence to which these components refer. 

The Development of. Competence 

The process of instniction, as distinguished from education in general is, to a 
large exteht, concerned with the development of competence in a learner and 
with the behaviors and cognitive structures tiiat differentiate the novice from the 
competent performer in a particular subject matter. In attaining subject-matter 
knowledge and skill, the learner proceeds through a novitiate and then develops 
relative expertise; he or she learns to be a good reader, a competent mathema- 
tician, a deep thinker, a quick learner, a creative person, an inquiring indivi- 
dual, and so on. These activities are learned according to criteria of expertise 
established by the school and the community; more specifically, by subject- 
rfiatter requirements, [)eer-group expectations, and the general Social and profes- 
sional criteria for what determines low, average, and high levels of competence. 
The educational and social community adjusts its expectations to the compe- 
tence level of the learner so that initially awkward and partially correct per- 
formances are acceptable, whereas later they are not; a young child Or a novice is 
frequently revyarded for rather uninteresting behavior, but as competence grows,' 
his performance is attended to only if it occurs in the presence of an appropriate 
audience or in an appropriate context. 

The gross changes that take place as an individual progresses from ignorance to 
increasing competence are of the following kinds: 

1. Variable, awkward, and crude performance changes to^erformance that is 
consistent, relatively fast, and precise,. Unitary acts change into larger" response 
integrations and overall strategies^^ 



306 ROBEF^TGLASFR 



2. The contexts of performance changes from simple stimulus patterns with a 
great deal of clarity to complex patterns in wliich relevant information must be 
abstracted from a context of events that are not all relevant. 

3. Performance becomes increasingly symbolic and covert. The learner re- 
sponds increasingly to internal representations of an event, to internalized 
standards, and to internalized strategies for blinking and problem solving. 

4. The behavior of the competent individual becomes increasingly self- 
sustaining in terms of liis skillful employment of the rules when they are 
applicable and his subtle bending of the rules in appropriate situations. Increas- 
ing reliance is placed on one's own ability to generate the events by which one 
learns and the criteria by which one's performance is judged and valued. 

It is the understanding, and facihtation of this process of change from 
ignorance to competence, from novice to expert, that is a major focus of the 
framework that I shall now describe. 




Description and Analysis of Competent Performance 

I^irst, description and analysis of competent performance the state of knowl- 
edgi? and skill to be achieved. Since attention to the instructional problem means 
facing the necessity of studying behavior in tasks considerably more complex 
than those typically studied in the psychological laborjitory, the development of 
new ways of analyzing tasks and specifying the gontent of learning is required. 
Tasks in the laboratory have been selected, for the most part, according to what 
is convenient imd manageable for experimental and theoretical analysis. Concen- 
tration on tasks artificially constructed for experimental purposes has meant 
that few psychologists have, until recently, confronted the problem of analyzing 
complex tasks in terms that allow access to psychological theory aind data, and 
yet still preserve some nddity to the real-life character of the tasks themselves. 

For the psychologist concerned with instmctional processes, however, --the' 
problem of task analysis, is a central one. Analytic description of what is to be 
learned facilitates inslructioii by attempting to define clearly what it is that an 
expert m a subject-matter domain has learned: for example, what it is that 
distinguishes a skilled from an unskilled reader/ When this analysis identifies- 
classes of behaviors whose properties as learning tasks are known or can be 
systematically studied, then inferences concerning optimal instructional pro- 
c«»sses can be tornnilated and tested. 

Procedures have been developing for the analysis of tasks-analysis of the 
e()ntent of what is learned- and the properties and processes involved in compe- 
tent performance and task analysis is characterized by the description of 
performance in- terms of the demands placed on basic psychological processes 
such us attention, perception, and linguistic processing, and on knowledge and' 
skills assumed to be in the learner's repertoire. Further, since an individual's 
capacities change over time, task analysis rellects current knowledge and assump- 
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tions concerning the processes available at different stages of learning or develop- 
ment (see Resnick, Chapter 3; Klalir&Wiallace, 1976). 

As this volume reflects, a major activity in this regard is being carried out 
through modeling and simulating (computer simulation or otherwise) processes 
that can reproduce complex performances like ,playing chess, solving algebra 
word problems, series completion problems, certain problem-solving skills, and 
understanding complex instructions. The processes chosen represent a combina- 
tion of what is observed in the performing subject and of theory concerning the 
characteristics of the conceptual processes, memory processes involved, and the 
semantic information structures that are built up. The simulation of complex 
performance represents a formal teclinique for establishing the logical sufficien-^ 
cy and necessity of certain processes and the way they 'are assembled for 
producing particular performances. However, for the purposes of instructional 
design, the next moves required in cognitive simulation work have not been 
made, and we need to investigate further. It is possible that the information 
obtained from this kind of analysis of human competence can allow us to do 
several things with regard to the optimizing of instruction: 

\. Specification of the processes by which highly competent individuals might 
be performing a task puts us in a position^ to try to teach these processes to 
individual learners;*for example, knowing that a large "perceptual vocabulary" 
of the configuration of pieces on a chess board is a characteristic of an efficient 
chess player might encourage us to attempt to teach this kind of performance in 
order to develop good chess players. ^ 

2. Knowing that a task is performed more efficiently in one way rather than 
another and knowing the procedures involved in the more efficient way may put 
us' in a position to design instruction so that it approximates the most efficient 
.method. < . . 

, The very interesting question at the morhent is the teachability of, the 
processes that are identified through simulation. If we teach these processes, 
then is . acquisition of the performance influenced, and will more individuals 
obtain competence than have In the past? Or, is it likely that if we teach these 
processes, we will put the learner in the position of the centipede who analyzed 
the processes by which he moved his huridred legs, and became incapable of 
walking at all? At any rate, in my -own laboratory (Il^^lzman, 1975) >ve are 
currently investigating the teachability of processes that have been derived by 
procedures of cognitive simulation. As a start, the particular task we have chosen 
is the. series completion problem as analyzed by Simon and Kotovsky (1963). 

A look at the current literature in experimental psychology shows an increas- 
ing number of studies devoted to the analysis of complex cognitive performance 
in contrast to the study of learning.* While this trend is contributing to the 
description of Competence in intellectual tasks, many of the studied can be 
faulted, from the present point of view, for their lack of expHcit instructional 
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orientation. The explicit requirements necessary for the analysis ot* tasks relevant 
to the development of an instructional psychology are the following: (1) that • 
complex reul-hfe tasks be investigated and not tasks designed for laboratory 
convenience; (2) that these realistic tasks be analy/.ed in terms of current 
theoretical concepts in cognitive psychology; (3) that the processes identified be 
considered with respect to their instructability and the conditions that influence 
their acquisition; and (4) that they be related to the cognitive capacities or the 
developmental status of the cliild and to the background capabilities of adults* 

Description and Diagnosis of the Initial State 

The second component of instructional. design is description and diagnosis of the 
initial state with which an individual begins a course of learning. Tliere is an 
"immediate'' and a "long-term" approach to this aspect. The immediate 
approach is to take seriously the fact that effective instruction requires careful 
assessment of. the initial state of the learner. For individual learners, we need to 
know their strengths, weaknesses, styles, and background interests and talents. 
What are the details of what a child knows and does not know at particular 
points in his or her learning? What are the det^Is of the skills tliat he^or she is 
developing? What needs to be improved? What strengths can be capitalized on? 
What do various developmental levels and various cultural backgrounds mean for 
.what should be^j-taught and how it should be tauglit? Educational practices need, 
to be designed so that answers to these kinds of questions are possible for all 
individuals attending school. Teachers and learners need to be in a position to 
obtain and utihze this information; with it, teachers can prescribe the instruction 
required .and students can assess their own abilities and select appropriate" 
instruction. . . 

The development and use of procedures Tor providing this information is 
necessary, but I do not m^an at all to imply that learning and schooling should 
be one big series of formal tests and assessments. I would suggest informal 
observation as well as infrequent, formal assessment, and adoption of an-jattitude 
that the information obtained is information for improving instruction and not 
for constant'cvaluation. My colleagues and I, in our own work in schools, have 
found it desirable to provide primary-grade teachers with hierarchies of increase 
ing competence in various school subjects. These take the form of "structured, 
maps'' iiito wiiich a teacher can place a child and thereby direct attention to 
prerequisite skills that . might need to be learned or advanced skills that the child 
miglit explore. The hierarchical map is only a guide upon which both the teacher 
and the child can impose their own judgment. Procedures for assessing -the 
current competence and talents of the learner in a way that provid^^a basis for 
instruction arc geiierally not available in curupnt educational methods at a level 
of detail necessary for the effective guidance of individual learners. I call the 
implementation of these procedures the "immediate'* approach because, to a 
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large extent, it is secondarily a matter of research and primarily a matter of 
administrative change and the design of appropriate materials. 

The long-term approach relates to the fact that while a prevalent method for 
assessing initial state is the assessmerit of aptitudes that correlate, to some 
extent, with end-of-school achievement, aptitudes so assessed do not provide" 
information about instructional processes (see Glaser, 1972; Hunt, Frost, & 
Lunneborg, 1973). They are measures used for purposes of selection and do not 
provide a basis for deciding upon instructional alternatives. Aptitude informa- 
tion does not tell how an individual should.be instructed to improve his 
performance, nor how instruction might be designed to make the attainment of 
successful performance more probable. The significant research requirement in 
tliis regard is to describe the initial state of the learner in terms of processes 
involved in achieving competent performance. Tliis would then allow us to 
influence learning in two ways-to design instructional alternatives that adapt to 
these processes, and to attempt to improve an individuaPs competence in* these 
processes so that he or she is more likely to profit from the instructional 
procedures available. 

Conditions that Foster Learning 
and the Acquisition of Competence 

The third component of instructional design comprises tlie conditions thgt foster 
learning and the acquisition of competence-essentially, tlie procedures by wliich 
one learns and the nature of the environment in-wliich learning occurs. There are 
at least two directions. hi this regard that need to be taken for the development 

• of an instructional psychology. ^ 

The first is to recognize that we do know a little about learning. For example, 
we know some tilings about the effects of reinforcement-the contingencies 
consequent to performance; abput the conditions under which discriminations, 
generalization, and concept formation take place; and about conditions of 
practice, interference with memory, the nature of attention, the' effects of 
punishment, and how observational learning and modeling can influence new 
learning. We know tliese^ tilings in terms of descriptive science, but little investi- 

, g'ation has been made from the point of view required for the utilization of this 
information for designing the conditions of instruction. Exceptions to this are 
the^ work on behavior modification ajid the work on optimization models 
described in the chapter by Atkinson. However, neither of these enterprises has 
considered complex cognitive performance in any systematic way. 

What is required is research on what we know about learning c^dst into the 
mold of a design science which attempts to maximize the oufcomes.of leaniing 
for different individuals. A new form of experimentation would be called for 
where the tactic .is not to develop models of learning and performance, but to 
test exis-ting models by using them for maximizing the effects of learning under 
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various conditions. For this purpose, we need a theory of the acquisition of 
competence. Such a theory would be concerned with how an individual acquires 
increasingly coinpiex performances by assembling the present components of his 
repertoire, manipulating the surrounding conditions and events, and employing 
his knowledge of how he leams. 

Effects of Instructional Implementation 

in the Short and in the Long Run • 

The fourth component of instructional design is concerned with the effects of 
instructional implementation in the short and in tlie long run -effects that occur 
immediately in tlie context of instruction and supply relatively immediate 
feedback, and effects that persist in terms of long-term transfer, generalized 
patterns of behavior, ability for further learning, and so on. One requirement for 
this purpose is to break away from the tradition of norm-referenced measure- 
ment to measurement more concerned with identifying the nature of cilterion 
performance (see Glaser, 1963; Glaser & Nitko, 1971), For effective instruc- 
tional design, tests will have to be criterion referenced in addition to being norm 
referenced. They will have to assess performance attainments and capabilities 
that can be matched to available educational options in more detailed ways than 
can be carried out with currently used testing and assessment procedures. This 
will be an important part of ^he development of a psychology of instruction. It 
is mandatory that testing not stand out as an extrinsic and external adjunct of 
instruction. Tests need to:be interpreted in terms of performance criteria so that 
the learner and the teacher are informed about an individual's progress relative 
to developing competence. In tWs way, information is provided for deciding 
upon appropriate courses of action for assisting instruction. 

The proce'sses measured by tests designed to facilatate instruction need to be 
related to processes identified as components of competence. For this purpose, 
some interesting endeavors can -be envisioned. A good example in this volume is 
the work going on in analyzing the processes involved in the comprehension of 
written language. Stimulated by the work in psycholinguistics and cognitive 
psychology, there is a great deal of excitement about the nature of language 
comprehension processes at this time. This excitement should be juxtaposed 
withjhe fact that there has, over years, been a great deal of work* on the 
development of tests of reading comprehension. The new development is that as 
we" begin to analyze comprehension tasks and relate them 'to theories of semantic 
memory, imagery, and so forth, we can begin to develop tests that provide us 
with diagnostic information about cornponent processes that contribute to 
performance and that can be influenced through , instruction. This kind of 
activity should cliange the nature of assessment procexlures and provide the kind 
of information required for maximizing instructional outcomes. 
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»* 

I would like now to comment on specific chapters in this volume in relation to 
the components that I have just described. 

Analysis of Competence 

Component one, the analysis of competent periormance, comprises most of this 
volume. Of the components that 1 listed, diis volume rates high on the explica- 
tion of performance theory and the analysis of states of competence. Several 
themes were elaborated on: description of competence in terms of cognitive 
structure, sequential task analysis to show changes brought about by instruction, 
and processes a$ objectives of instruction. Greeno and Norman stressed cognitive 
objectives; they would like to display a student's cognitive structure and state 
instructional objectives in this way. this is an interesting idea; it makes contact 
with their theoretical notions, but they leave us with mere technological prob- 
lems. Carroll brought up this point when he askQ4 how one t^-^ohes toward these 
unobserved competence maps. Greeno implies that analyses of cognitive struc- 
ture can be; given directly to teachers and students in order to facilitate the 
acquisition of competence. It is hard to envision just how this is to be done, but 
it does present the notion of progressive,, increasingly complex theories of 
subject matter that assist learning and are approximations to the kinds of theory 
that a competent expert employs. Teaching procedures based on cognitive 
structures of developing competence might , make use of these schemata as 
pedagogical frameworks that must be developed to more and more closely 
approximate the theories that an expert carries around in his head as sophisti- 
cated codifications of a body of knowledjge. It is also possible that these 
developing structures of subject-matter knowledge might suggest ways of design- 
ing new kinds o£ textbooks. ' . ■ 

A significant problem in the specification of cognitive objectives for instruc- 
'tion is level of description, a problem also raised by Carroll. How does one 
describe these struGtures? Are they described in the same terms that the details 
of cognitive processing and cognitive theories are written in? There is no answer 
to this question forthcoming from this volume. It may be useful, however, to 
point out that when Atkinson built his instructional programs in reading and 
computer science, he .began with standard subject-matter units. He looked at the 
subject matter and brOke. it up into what seemed to be reasonable units, as .any 
instructor would dp. On these units of analysis, he imposed his instructional 

^Editor's note: In Uiis section there are sevetiii references to the material introduced at 
the Workshops presented during the symposium by Collins, Fletcher, Hayes; Sicgler, a'od 
Wallace. F-or a very brief summary of these Workshops see the Preface to tliis book. 
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teclinology. In the case of learning foreign language vocabulary, he analyzed the 
^subject matter in more cognitive terms. This Was part of his implicit description 
of the building up of memory structures 'that underly the competence he sought 
to teach. As a general answer to the level-of-analysis problem, it seems that there 
should be a difference between science and practice. A petroleum chemist cah 
think about atoms and forces in molecular structures, but he also can ttiink 
about gross quantities of gases and residues in the fractionating tower. His 
theory can work back and fortli between the two systems of description. The 
'linking science'" 1 mentioned earlier should enable this to occur if at all 
possible, " 

In optimization procedures such as those carried out by Atkinson, task 
analysis proceeds as learning occurs. Continuous assessment is. made of the 
difilculty and structure of the task. Tliis technique of ongoing task analysis 
might be a useful way to study the acquisition of competence. For example, in 
the BASIC Instructional Program, the program stores the student's evaluation of 
his own skills and compares his solution attempts to stored models. In this way, 
information can be obtained about the changing structure of 'developing compe- 
tence that might not be uncovered by more static techniques, 

A recurrent theme of the volume is that a target cjf instruction is competence 
in process, for example, the constituent comparison exercises to improve reading 
comprehension suggested by Just and Carpenter. Shaw's generative system might 
b*e thought of as a special process skill that is a teachable entity, and not only a 
theoretical description of what occurs. Simon and Hayes suggest giving students 
a wide repertoire of problem-solving styles and detection cues for niatcliing 
styles to situations. 

Diagnosis of Initial State 

In contrast to the analysis of attained competence, this volume had less to say 
aboiit this second component, the diagnosis of the initial state. There were 
several themes: notions about some kind of ps;/chorheti1cs of process for initiql 
slate assessment, consideration of developmental growth changes, and the notion 
of sciiema discrepancy between initial state and competence state. Calfee in 
Chapter 2 emphasized tecliniques for the assessment and diagnosis of processes, 
in initial' state competence. Wallace referred to "process profiles" prior to' 
instruction and the design cif custom-built t.raining as a function -of these 
profiles. Siegler talked of the developmental aspects of the facility of older 
children to use imalogy information as compared to younger children, and he 
brought to our attention the. necessity for taking developmental growth phe- 
nomena ij,Ut) accouiu in assessing initial states, Ilyman's notion of discrepancy 
from schema, the extent to which old information influences new information, 
strongly suggests initial competence analysis prior to a course of instruction. 
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Acquisition 

The third component involves a theory of acquisition-of transformation from 
an initial state to competent performance. Tliis component was not explicitly 
addressed in most chapters. Th^re was some concern about the properties of 
performance that are involved when someone proceeds from novice to expert: 
tlie growth of tlie cognitive net, increasing symbiotic manipulation, concept 
generation from specific events, decreasing dependence of performance on 
external cues, bigger chunking underlying performance, and so on. The charac- 
teristics of the changes in competence as one moves from novice to expert are 
primary data required for a theory of acquisit'on, and earlier, I described some 
gross features <of these changes. Wallace discussed changes in the acquisition of 
competence when he described the shift in "attentional grain" from global 

0 attention to dimensional attention. Resnick presented her work with Groen that 
described the change in children from ojie method of addition to a more 
efficient one. - ^ 

In general, however, while the contributors had some interesting ideas about 
processes of developing competence, when they talked about teaching these 
processes, they fell back on standard "behavioristic" training procedures. Wallace 
mentioned *'failiire theory" by which he meant that he obtained information on 
process deficiencies and then tauglit to these deficiencies. The procedure he used 
was a form of the successive approxir -^tioris procedure popularized by Skinner. 

^JHayes talked about teaching problem solving and employed good common-sense 
teaching procedi^i^es. In talking about generator sets, Shaw emphasized the 
importance of good exemplars in the development o.i concepts, which is a 
familiar .technique developed in behavioral studies of concept formation; this is 
an important pedagogical matter because the experience one gets in school may 
not be^ very well designed to provide rich exemplars of concepts, and Shaw 
"emphasized tliis again'at a deeper process level. Collins, after his careful analysis, 
used Socratic dialogue as his instructional procedure. Norman, in the acquisition 
of^knowledge, stressed the importance of continuous modification of a knowl- 

. edge schema, and then when pressed about teaching technique, he suggested 
practice with feedback. The point is, as 'Carroll indicated, that behavioral theory 
is successful because it focus(fs on observation of the devdopment pf behavioral 
components; cognitive theory . at this time is difficult to express in simple 
observable terms, and it certainly needs such expression to decide upon appro- 
priate instructional .transformations. When this is done, how will teacliing pro- 
cedures change? 

Norman made a good point in calling attention to time spans m attaining 
competence. He .said that it takes five to ten years to become a good cook, and 
an interesting question" in going from ignorance to competence is why different 
areas of knowledge and skill require longer and shorter times for competence to 
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be attained^ Instruction to be thought of in such terms; learning to play the 
violin well takes a long tfnie, whereas learning to do calculus well does not^take 
very^ long.i There are differential rates of acquisition for certain reasons, and 
these reasons are of great irt^terest in developing a theory of yct^insition. 

The human engineering' ak)ect of instruction was brought out in th^ work of"" 
Simon and Hayes, Greenoi and Just and Carpenter. Their findings suggest 
possibilities for the redesjgn W instructional material and of the environment- in 
which instruction occurs. Sucri" redesign may be as important or more important • 
tlian tacfics of instruction.. \ 

As I tiave already said, Atkinson addresses the acquisition of competence by a 
'procedure of continuous decision making-decisions for prescribing the condi- 
tions of learning that need to be presented as a function of the data obt<iined on 
student performance. The question that comes to. mind is whether the kind of 
optimization procedure he employs is a good direction for a science of instruc- 
tiun. The procedure' rdquir^s mathematical statement of a learning function-, this 
is now possible, as Atkinson indicates, only for^very simple and quite trivial 
kinds of behavior. The question is the following: If one thinks of using these 
optimization procedures with the more complex theories of cognitive structures 
presented in this voluiVie, then how are they expressed in a form that might be 
used with the optimization procedures available? Even if mathematical expres- 
sion is possible, feasibility of computation may get out of hand. 

Effects of Implementation , ; 

The fourth component of a psychology of instruction is measurement of the 
effects of tiie conditions provided for acquisition. In -this regard, let nie make the' 
point that the kind of feedback Skinner emphasized in operant conditioning was 
essentially informatjon on the topography of a response. In Skinner-like pro- 
grammed instruction, it appears that it is the topography of the response that is' 
life property of performance that- is being shaped -successive approximation, .a 
gradual, spatfaf getting closer and closer to terminal competence; it is the effect 
ol instructional conditions on this response aspect for which information is 
required to further ctniduct the instructional procedure. Atkinson uses as feed- 
back the difficulty of items in a list; lie employs response history and update of 
item difficulty parameters' to obtain measurements of the effects of instructional 
conditions, (ireeno ami Norman talk about getting information on the structure 
of the cognitivo map of knowledge, and as I suid before, they leave us with a 
large technical problem, flow do we measure '*it'' to assess instruction and to 
pr(wide the feedback required to student and teacher? Can a representation be 
provided to a teacher or to a student, and can they be tauglit instructional skills 
by which they can change- this representation? Fletcher reminded us that if we 
use a computer for storing models of individual students to represent their state 
of learning, we would seriously tax computer memory. • \ 
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I mentioned the notion of a psychometrics of process measurement, and this 
brings up a point about the analysis of SAT competence in the work of Just and 
Carpenter. When they analyze ^he SAT-type examinations, they may be getting 
something out of their analysis that is not what they are looking for. The SAT 
tests are designed, in the usual psychometric way, to yield a spread of scores. A 
dispersion of item difficulty is built into the test in order to maximize test-score 
variance so that the correlatiori with criterion variables is maximized. The tests 
are selected both for the stimulus situation they provide and for certain psycho- 
metric properties. When Just and Carpenter analyze the performance processes 
involved in the SAT tests, they may be analyzing also tlie properties of psycho- 
metric item difficulty. The extra considerations builf into the. requirements for 
obtaining correlational validity may introduce extraneous processes that would 
not be present in a test designed to measure criterion performance more directly. 

As a final remark, I must ^tate as strongly as possible that we cannot tliink in 
terms of standard classrooms as we begin to think about the application of the 
concepts of this volume to the design of instruction. Even if we claim to know a ^ 
good deal about the processes involved in word decoding and beginning reading, 
the engineering problem of classroom material and environmental design is ever 
present. If we continue to think in terms of the standard classroom rather than 
in terms of how schooling can be restructured-, then our efforts will be seriously 
attentuated and kept down by the weight of traditional educational modes. 
Finally, I agfee with and must reemphasize a general sentiment of this volume 
that work on instructional and educational problems will be a major test of our 
theories of human cognitive performance. 
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Implications for ^ 
Instructional Research' 



Courtney B. Cazden * 
HarvaM University 



TheSL* comments come from a back'ground of elementary school teaching and 
..developmental psychology. Recently, 1 have been concentrating on how children 
learn (or acquire or develop) their native language, and on the environmental 
(events which may affect that learning in and out of school (Brown, Cazden & 
Bellugi» Cazden, 1972). I was an elementary school teacher in the late 

1940s and .I95{)s. Now Pm going back to teach children for one year in a 
primary classroom in an inner-city pliblic school. 

In .thinking about these plans, I realized that the three topics which Hugh. 
Mehan* director of the teacher training program at the University of California, 
San Diego, and I proposed to investigate in my classroom can-all be reformulated 
in terms of topics discussed here. (A validation of the sophistication of our plans 
or the real-life relevance of these discussions?) First, what is a "relevant curricu- 
lum"'.* In Norman's sense, what do children know that's relevant to what we 
want to teach relevant either because it can help or because it may interfere? 
Seeond, how do children understand or fail to understand instructions, primarily 
~ oral instructions because the children will be young and on the edge of literacy. I 
n^ean particularly the kinif of instructiofis tliat teachers seem to give frequently 
(Mehan, 1^)72) and that are ill structured in Simon and Hayes' sense because 
they put ^'demands on the knowledge and repertory of problem-solving skills of 
Uie solver" (page 27^))? Can we help children cope with such questions by 
recognizing their incompleteness and asking for more information? Third, in 
what subtle ways do teacher expectations, get produced on the one hand, and 

'I dUnr*s note. In this chapter tliere are several references to material introduced at the 
Workshops presented during tlie symposium by Bamberger and Collins. For a brief summary, 
of these Workshops, see the Preface to.tliis book. Bamberger's work is also described in 
Bamberger (1972). and Collins' in Collins, Warnock» Aicllo, and Miller (1975). 
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have their eftects on the other hand? As one example orHynuin*s concern with 
how people make sense out of their world, how does a teacher in a very complex 
environment make sense out of her children? If I refrain from "preparing my 
mind'* (to adopt Hyman's phrase) and do not look at the children's cumulative 
records, am we track how cues frotu the children are used in making decisions 
before, or during instruction, and how the categorizations af the children that 
will inevitably be built up aftcct my interactions with them? 
In spelling out these reformulations, of my plans for next year, I don't intend 
to imply that the deliberations of this conference should be judged by tlieir. 
usefulness next September. On the contrary, the more appropriate question is 
about the implications for research on instruction during the next five years. 
From that perspective, the comments below fall under four headings: the 
concept of instruction, cognitive objectives, tasl\ analyses, aiid means of instruc- 
tion, 

i 

THE CONqEPT OF INSTRUCTION 

I am impressed by the broad concept of instruction explicit in some of the 
cjiaptens, and implicit througiiout this volunxe. In its catcliiest version (Olson, 
this volume), instruction includes muddling by the learner as 'welf as modeling 
'and meddling by the teacher. In kesnick's (Chapter 3) more precise definition, 
instruction means '^any set of environmental conditions that are deliberately 
arranged to foster increases in competence. Instruction thus includes demon- 
strating, telling, and explaining, but it equally includes -physical arrangements, 
structure of presented material, se(iuences of task demands, and responses'to the 
learner's actions [page 5 1 1 In Carroll's application to language skills, instruc- 
inm is '\lefinecl broadly as any external influences on the development of 
language skills, as represented both by formal teaching actiohs and by more 
informal social in ter^tions [p^ge 5] 

There have undoubtedly been many influences on this broadened definition. 
For me, two of the most important Have been the writings of more persuasive 
proponents of ''open" or 'Mearner-con trolled'' education, and the research on 
language learning which CarrciH has summarized. There is a noncoincidental 
relationship between these two' influences, because the ease with which children 
learn their native language without instruction more narrowly conceived has 
been used (e.g. by Holt, 1967; Morrison, 1964) as an argument for more open 
education. Resnick's definition extends this broadened concept to all learning, 
not just language, and to all settings, not just the one formally designated place 
we call a classroom So, for example, the design of museum displays mentioned 
by . Shaw (pages 298-2^)9) js included, and becomes one among many additional 
.settings for research. 
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. COGNITIVE OBJECTIVES 

Like the cunoopt of iiistnjctii)n, (lie concept of cognitive objectives is a signitl-> 
cant contribution of tliis conference: in nil discussions, cognitive objectives 
comprise both conceptual and procedural knowledge, or'**semantic networks 
and probleiu-solving algorithms'* ((Ireeno, Chapter 7). But the distiiiction be- 
tween these cognitive (Objectives snd the older formulations of beluivioral objec- 
tives needs to be strengthened further if it is not to collapse under the pressures 
of evaluation, hvahuition reijuires judgment about some behavior. How cnn the 
eviihiator be sure that n particular behavior indicates underlying knowledge 
rather than rote and limited procedure? in Wertheimer's temis (Resnick, pages 
58-5^)), how can we tell the difference between ''imderstanding" and "insight" 
V;S. "ugl\ problem solving solutions? In the terms now used in the language 
domain (defined by Carroll, Chapter 1), how can we infer underlying compe- 
tence iron] any particular performance? 

(ireeno (Chapter 7) suggests two criteria for meaningfulness: **goodness of 
structure" and "s<ilvin.i» in the problem domain" (pages 147-148). ''Goodness of 
structure" is an accurate name- for the criterion used in language development 
research. When a child says / Jan^t want milk, we decide whether to credit that 
child with the knowledge of don't as an auxiliary by determining whether, in 
this cliihrs language system, don^t is simply a single, unanalysed chunk, an 
alternative negative to no, or wliether it coexists with other auxiliaries, positive 
as well as negative e.g., can and will and doesn't as well ixs don't. *Tjoodness of 
structure" in language thus hieans that a. particular element is a connected part 
of a larger system, arul is reci)mbinable in multiple patterns. More generally, this 
is also Norman's concept of understanding (Norman, Cientner, and- Stevens, 
Chapter • 

With regard to evaluatiiMi, (ireeno says, "... evaluation must come from the 
potential users of the prinluct, not trom one who proposes to offer the products 
for use. , . . I'valuatiiMi may be possible when we can di.splay a relatively 
complete anah sis i)f the kmnvledge ilesired in some subject [p. 1 58| ." Working 
out the details \\)r evaluating ciignitive objectives in all domains should become a 
high priority task, 

TASK ANALYSES 

If we accpt, as 1 think we should, Norman's description of the learning process 
as one of C(Mumunication, with all participants attempting to form new meatal 
structural representati(^ns that will account for the infornuition which they 
experience, then two kinds of task analysis are needed. One, usually called by 
that name, is an analysis of what the child has to learn; the other, usually called 
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hv sonic other tiaine Mich as diagnosis.* is a ilcsctiptiDii ol what the 
teacher has to ilo as Iw.nuikcs decisions (or forms hypotiieses) about what and^ 
how to leacii. The tnst is discussed by Re.snick' tiie second is discussed by 
Atkinson in his explanation of how con\puter>assisted instruction can be indi-- 
viduah/ed and optinu/ed, and by Allan Collins in his demonstraticMV of how 
tutors of gei^graphy llnd out about, the preinstructional knowledge of their 
pupils. The task oi diagnosis is ihfferent for ct)niputers and hunun teachers, not 
only because the teacher brings to the task a more richly prepared mind which 
may help or interfere, but also because of the magnitude of the int\)rmation 
processing task. Of the ten panels assembled hy the National Institute of 
luhh-ation iti July, 1^)74 to suggest plans for research on teaching, one, chaired 
by Lee Shulman, considered teaching as clinical information processing in this 
sense. 

One of Resnick's four requirements for task analyses of what children have to 
leain i> that tliov nuist "r,ecogni/e a distinction between early forms of compe- 
tence arid later ones , . . [and must] describe pcrfornunce characteristics of 
novices and aitemjU to discovei or pt)int to key ditYerences between novices and 
expcits, suggestnii^ tlii-iehy ways of arranging experiences that will help novices 
HectMne experts [page Certainly in language and - in the domains of 

knowledge studied by Piaget, and [uobably m otlit^rs as well, the knowledge^ of 
novices is nt)t simply an incomjilete version of the kntnviedge of the expert or 
mature learner; it is qualitatively different. While some of the difterences may, 
upon closer exanilnatitni td' the underlying })rocess, be due to the lack of some 
conce[)tuiil or procedural knowledge, otlier difterences seem more a result of 
attention to different features of an event than is characteristic of adult minds 
and, or embodied in culturally transmitted forms of representation. 

In the course of language devek^j)ment, tor example, children utter verbs hke 
goed and iinpccl, and the> answer the question What are you do'mgj in the fojm 
/ doing dancing. These immature ft^rms can reastinably be considered as the lack 
of knowledge of contextual r(!Strictit)ns on the generality of a particular pattern. , 
And the childish question Why ! van 't go'] can reasonably be considered as the 
lack of ir'particular operaticui that rever.ses pronoun and auxiliary. But explana- 
tions of incompleteness do ntU sti easily fit the categorizations of sounds 
underlying young children s invented spellings (Read, 1971), nor children's 
represciitatimi.N of musical tunes that Jeanne Hamburger described.^ 

Tlieie are also individual differences in the course of learning, and maybe 
culturally-derived group differences as well. These are only beginning to be, 
looked at in research on language learning. It seems to be a general methodologi- - 
caKprinciple that the search for universal patterns precedes the search for 
variations on them. 

^ I am not suggesting (even if I know how) to build such qualitatively diffelent^^ 
novice stages into an instructional program- as intermediate objectives. But we 
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need to take them into account, not just to value them as indicators of learning, 
but also to experiment with how best to use them as the basis for continued 
growth. Jeanne Bamburger's demonstration of children's learning musical struc- 
ture is a fine. example. As she said, children's muddling must guide teacher's 
nieddling. 

Flavell (1972) has made an important attempt to categorize tlie restructuring 
that takes place between points in cognitive-developmental sequences as not just 
addition, but also substitution, modification, inclusion, and mediation, Nor- 
man*s protocols of adults learning to cook and learning a computer programming 
language show that the knowledge of adult learners, as well as children, must 
often be modified and not just added to. 

In advocating this more complex model of the course of learning, I don't mean 
to devalue examples of the best we now know how to do iii instructional* 
design such. as Resnick's arthmetic hierarchy and Atkinson's sequences in each 
strand'-of his program lor beginning reading. But in the lon^r range, 1 hope that 
Nomian's model (more adequately described in his text than in his too addi- 
tivcly drawn diagrams) will guide future, research.' 

In all task analyses, it is essential to remember; that a formal analysis of the 
structure of sonie knowledge or skill does not necessarily, or even probably, 
reflect the organization in anyone's head, much less how it got there. I'm not 
sure whether Greeno's statement that "a theory specifying. cognitive structures 
and processes sufficient to perform those tasks is a candidate hypothesis about 
what the instruction is trying to produce [p. 124]" clarifies or confuses. The 
recent history of p^ycholinguistic research reminds us of thelmportance of this 
distinction, as Carroll and Just and Carpenter point out. And th^re is no reason to 
believe that the story will be different elsewhere. If we intend only effective 
.instruction, then the justifying criterion of effectiveness may be sufficient, as 
Greeno andvRcsnick suggest. But if a model of cognitive processes is so.ught, then 
more thorougli psychological validation - is required. Anyone engage^in such 
endeavors should read Holt's satire of task analysis in his description\f how 
children would be taught, presumably less successfully, how to talk (Holt, ''1,967, 
pp. 5b-51)^ if only to be sure where and how he is wrong. 



MEANS OF INSTRUCTION 

As ResfTick demonstrates, even with a "good" task analysis, the mapping from 
identified components to instn^otional strategies remains very much a matter of 
artful trial and error. 

Negatively, I am concerned about the rigidity of instruction embodied in 
Atkinson^s second and third optimization levels [pages 93-99]. The first level, 
optimizing the sequence within each strand, is less of a problem just because 
a smaller component of the total program is involved. But when all con- 
trol is taken away from the leairner, regardless of what and when he is eager 
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to learn, adaptation to individual interests and motivation becomes impossible. 

I realize that the effectiveness , of second-level optimization is an empirical 
question, but it is not easily investigated. Not if we evaluate the effects of 
instruction in long-range terms and look for side effects along this way, as Olson 
urged in his comments. 

Atkinson's data t)n tliirtl-lcvcl optimization is extremely interesting. In a 
current controversy about ways to increase equality of educational opportunity, 
Sesame Street (which reaches everyone) is pitted against Headstart (which is 
limited to poor children). Atkinson's data is the first I've seein that specifies 
exactly what;has to be done to maximize the group average, or minimize the 
group variances, or increase the average while not increasing tlie variance. As 
research data it is very important. But, although I agree with Atkinson's 
selection of the third goal as liis optimizing criterion,, the question of the effect 
on individual children of the rigidity entailed by any attempt to optimize at this • 
level still remains. 

More positively, 1 want to en.ipha.size the importance of questions about the 
form of instructit)!!, its timing, and the value of practice. What are the most 
effective forms in which, to communicate to the learner what he needs to know 
to make progress? Some learning takes place through the full participation of the 
learner from the beginning, regardless of the immature forms tliat the learner 
uses, with subtle and little uridcrstood forms of feedback producing successively 
more mature approximations of expert .behavior. Oral language is perhaps the 
best example here, but it is not the only one. 1 have seen tliree-yeq,r-old native 
American boys dancing with older siblings, parents and grandparents, doing an 
incredible job (by our standards of age-appropriate motoric development) of 
keeping in time. It may be the case that full participation even witli childish 
performance is characteristic of those learnings for which special educational 
settings are not required. But we could try out extensions of this model to our 
more formal educational, objectives. We could let children learn to write without 
correcting their spelling; and, 'as Norman suggested in one discussion, we could 
let children learn to read witliout correcting every semantic error they make. 

Wliere this more informed nu^del of learning does not-iipply, what is the best 
level on which to focus the learner's attention? In teaching a motor skill such as 
square dance swinging, I have found it more helpful to use the metaphor of 
making your feet gt) as if on a .scooter tlian to detail the component motions. In 
teaching subtraction, Resnick suggests that it is more effective not to try to 
teach the mature algt)rithm directly, but' rather to find a more easily instructable 
process from which the' children can discover the rest themselves. Clearly, more 
research is needed on effective forms of instniction for varied educational 
objectives.. 

What is the optinfal timing for confronting the learner with the discrepant 
information he needs to move on? In the kind of infornral learning that proceeds 
from full participation in ongoing experience, that discrepant information is 
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always available,^ and the child makes selective use of it in his own time. But in 
more formal educational settings, out of the contexts where experts are perform- 
ing alongside learners, we face timijig decisions that are difficult indeed. 

Finally, what about the value of practice? It was only discussed informally 
here. Yet practice is one variable whose role may vary significantly between 
short-term ^experiment;il and long-term educational types of instruction. Carey 
(1974) suggests that the practice of constituent skills necessary for dieir incorpo- 
ration into more cdmplex structures-"modularizdtion in Bruner's term-applies^ 
to cognitive achievements as well as to motor skills. Children engage in self- 
generated practice, (see Cazden, 1972, pp. 93-97; Cazden, 1974, for language 
exaniples). Does the effect of practice on learning vary depending on whether it 
is so self-generated or designed and imposed by someone else? If practice is the 
label we give to seemingly valuable behavior, than "bad habit" is the comparable 
label for repet^ions of behavior tliat leave something to be desired. Immature 
language forms, such as those given above, are easily replaced as development 
proceeds, no matter how often repeated. they may have been. Can we specify 
more, generally the categories of behavior to v/liich the notions of practice and 
bad habit do and do not apply? These questions are admittedly imprecisely 
formulated. Because of their importance, for education, I hope they can be 
clarified from the p^erspective of this volume. 



321 



19 

Designing a Learner: 
Some Questions 

David Klahr 
Carnegie-Mellon University 



What do we know about what happens to a learner during instruction? One of 
the most exacting criteria for testing our knowledge about any phenomenon is 
the extent to which we can build a model that exhibits the behavior being 
studied. Ff we can simulate *it, then we have at least a sufficiency model. Of 
■course, there 'may be many aspects of the model that lack plausibility, but they ' 
can then become the focus of further study. (Reitman, 1967, once characterized 
•this simulation approach to cognitive psychology as a way to "invent what you 
need to know.'O this chapter I will raise some questions about how one miglit 
go about building a model of a learner in-an instructional mode (MOLIM). 



LEARNING AS PROBLEM SOLVING 

To learn is to solve a problem. In all but the most elementary situations, learning 
is under the learner's strategic control of attention and memory. If tliis view of 
learning is valid, then the study of complex problem solving-and tlie orientation 
such study provides to cognitive psychology -^has direct relevance for the design, 
of a MOLIM. In this section I will mention a few features of problem-solving 
theory that seem to justify the view of learning as problem solving, and that also 
have particular importance for the study of'learning. Then, in the next section I 
will raise some questions about the design of a MOLIM. 

Current information processing approaches to the study of human problem 
solving proceed by postulating a general system architecture, and tlien construct- 
ing explicit representations for the data structures and the processes that 
generate the observed problem solving behavior. A problem solution consists of 
an internal representation for some knowledge that the system did not have at 
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the outset. Problem solving consists of a series of local transformations of 
knowledge that ultimately reach the desired knowledge state. In several of the 
chapters in this volume (e.g., the^Greeno's Chapter 7), the "solution'' to the 
learning problem is explicitly represented as a data structure (semantic net) and 
a set of procedutfes for searching tlnit network. But note that these results-these 
solutions to the learning problem are static with respect to the learning process 
itself. That is, with 'respect to tlie time grain of the instructional process, the." 
results of instruction, even though tliey may tliemselves by dynamic processes, 
are structures upon with the learning system must operate. We need a model of 
the system's response to instruction, that is, its functioning in circumstances in 
which it must attend to the instructional episode and modify jts own per- 
formance structures i\nd processes. 

In our instructloni^l efforts, we try to provide optimal environments for the 
human uifornuition processing system to learn sor^iething. As it is with the horse 
led to water, so it is with tlieiearner in an instructional situation: we can't make 
it ingest wliat we offer. The instructional design question is typically ''Will the 
learner learn from this instruction?" A furtlier question should be "'Why should 
he learn?" The view of learning as problem solving suggests some ways to 
characterise tliis question*. Problem-solving theory (Newell & Simon, 1972) 
includes two features of importance for our purpose. One is a detailed internal 
representation of the task environment. The other is a characterization of how 
the human information processor allocates its limited processing capacity to die 
problem-solving process. A principal method for effecting this allocation is die 
use of explicit representations for -goals. Goals are symbolic expressions that 
direct and control the course of problem solving, representing what the system 
'^wants' to do at any moment, and **wliy" it wants to do it. Thus, the answer to 
whether or why the system will learn becomes, in view of learning as problem 
solving, a matter of stating the circumstances under which learning-related goals 
are generated and manipulated. 

SOME DESIGN QUESTIONS FOR A MOLIM 

In this section, 1 will raise fcnir questions that niu^t be answered by the designer 
ofaMOLIM: . . . 

1. When should learning occur'.^ 

2. How will the system be changed as a result of learning? 
How thoroughly assimilated is the thing to be teamed? 

4. How distinct is learning from performance? 

These questions, and their answers, are highly interrelated, and it is difficult to 
dett^rniine their appropriate order of presentation. Their ordering here is arbi- 
traryj.tiad..does not imply any particular differential iniportance in my mind. 
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/. When should learning occur? A curious problem with most of the learning 
models in both cognitive psychology and artificial intellignece is that they are 
too single-minded in tlieir task: they learn all the time. In designing a plausible 
MOLIM, we must be able to account for the fact that most of the time learning 
^ does not occur. We can do this by explicitly including in our MQLIM the precise 
conditions under which an instructipnal episode causes something to be learned. 
This is5 where the appropriate use of goals could play, a role. Rather than 
construct a system in which the tendency to learn is integrally built in to the 
underlying operating mechanisms, we can design a more general prdblem solver 
whose problem is to learn, and whose goals include explicit learning efforts. 

By themselves, such goals would still be inadequate for deciding when the 
system should learn. Additional information would be required about the 
current state of knowledge --that is, about both the current configuration of the 
external environment as well as tht Internal state of the system Thus, another 
design decision concerns those variables and their critical ranges which would, in 
conjunction witli the learning goals,,activate the-.self-modification processes. 

The mechanisms that determine when learning to occur ipust be capable of 
representing differentiid responsiveness to instruction. As Resnick (Chapter 3, 
this volume) has pointed out, our models must be able to represent both early 
and late forms of task proficiency, and for a MOLIM, the task is learning itself. 
Therefore a MOLiM must incorporate die capacity to represent botli early and 
late learning proficiencies. Siegler (1975) has noted the importance of experi- 
mental designs in which both older and younger children are given the same 
training sequences, in order to examine the possible interaction of age and 
instructional effects. Since such interactions have been found (e.g., Siegler & 
Liebert, 1975), we must be able to represent them^in MOLIM, through the 
general strategy, suggested by Resnick, of building developmentaJly tractable 
models. ^* . v 

2. How will the system be changed as , a result of learning? This is, perhaps, a 
more useful way to .say "what is learned?** There are several outcomes that can 
result from the learning effort. One result is that nothing happens: tlie learning 
attempt fails, and no lasting change is made in the system As noted above, this 
is more the rule than the exception in real instructional situations, and we must 
be able to build a system that can handle this fact. 

Another possible result is that the entire system architecture could change. 
That is, the system's components and their interrelationships might be altered. 
However, since by "system architecture'' I mean "hardware" rather than the 
"softwcire" of the human information processor, it seems unlikely that this kind 
of change is really the result of instruction. Altliougli it would be required in full 
developmental thet)ry, we need not he too concerned with it for now. 

There are two kinds of software changes that the system can undergo: changes 
in processes and changes in structures. .Newell (1972a) has demonstrated the 
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iniprccisd nature ot* the process- siriictiire distinction in systems tiuit are them- 
selves undergoing change, hi tiie case of a self modilying system, tiie :inihiguity 
hecomes even greater, since it is linked to the issue of degree ot' assimilation to 
he described below. Although one, often makes an apparently unambiguous 
ilistiuction bet\<^oeii instruction directed to acquisition of facts, and instruction 
directed to the teacJiing of procedures (or skills), it is clear from the worlv of 
Greeno, Hyman, and Norman (Chapters 7, 8, and ^) of this volume) t,hat thte 
issues, are not so simple. One can represent factual knowledge by procedures that 
can generate tluwe facts, and, conversely, one can represent what could be 
procedural outputs by appropriately ciMuplex static .symbolic networks. 

Another type of change that may result from instruction, and which we must 
therefore be prepared to explicitly represent in our MOLIM, is change in the 
learning'properties of the system beyond the representation of the specific 
instructional material. F'or example, in the case of the aggregiUc models with 
uhich Aiku^son tcf^iesents tlie leiuner, there are a few changes in the acc|uisition 
parameters that result t'rom tlie instruction. In more complex models of learning, 
such systemic modi Ilea ticms wnnikl include the basic rules of self-modification 
themselves. • 

3. How thoroughly assimilated is the thi ig to be learned? In the paper cited 
above, Newell (1^)72) distinjjuishes ■between several levels of general versus 
specitlc knowledge about a task. The more general the knowledge, the more 
trunsfi)rmational rules are necessary to take the system from if- y state at 
pert'oitiuvnce time to a task-specific state in which it can actually perform the 
task at hand. Conversly, a very task-specific piece of knowledge might be 
representeil in ^^machine code'': being fully assimilated it would require no 
interpretation at nm time, however it would be^of Hmitcd generality. 

A ctincrete example of this distinction is provided by the models for children's 
performance on seriati(Mi tasks developed by Baylor and Gascon (1974). In these 
models there are two kinds of representations for "seriation knowledge."" One is 
a base strategy, consisting only of series of ne:ued goals, that describe, at die 
most general level a strategy for seriation (e.g., ''"find max.'"' or "insertion"). The 
other representation is a rule set diat accounts for each mcwe made by the child 
during a specific seriation task, Behavior during length, seriation has one rule set, 
and behavior durii^lg weight seriation has another. If the system has only the base 
strategy, then it also requires a set of rules that take the base strategy and 
construct a task-specific variant (e.g., for weight seriation). There are vaiious 
ways to conceptualize this mapping. The two simplist are a complete "compila- 
tionT in which the base strategy, plus the task-si^ecific mapping rules, create an 
entire task-specific system that then runs on the task. The other is a collection of 
interpretive rules that never create a ta.sk-spo^Mfic entity, but instead interpret 
the base strategy, '^mi tlie run,'' in terms o( the specitlc task. 

hi designing a MOLIM, we must decide upon the assimiiatedncss of the 
information to be acquired. Tlie sematic networks i^f Norman and Greeno in this 
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volume appear Uvbe far toward the task-specific end of the spectrum, wlille 
Shaw ai d Wilson appear to be focusing upon a more general "base strategy" in 
• their reprtsentations of group generators. A similar contrast can be found m 
comparing Atkinson, (Chapter 4) with Resnick (Chapter 3). Atkinson is aiming 
at an instructional procedure that will create a very specific set of dat^i structures 
arid processes tliat will enable the learner to write programs or to, acquire a set of 
reading patterns. Resnick has begun to investigate the manner in which the 
learner abandons the task-specific instructions and creates a more efficient and 
general procedure. My strategic bet is that by representing the result of learning 
as "base plus interpreter," we may begin to get a handle on the mechanisms of 
generalization from, or beyond, the specific instructional sequence.. 

V 4. How distinct is the learning system from- ^ the performance system? In 
almost all models of learning, be they psycholo^cal models or examples of 
Artificial Intelligence, there is a clear distinction between the learning processes 
and tlie Ihing to be learned, that is, the performance system (see for example the 
models in Feigenbaum & Feldman, 1963, or Simon & Siklossy, 1972). The 
distinctions are made with respect to the over-all organization of the respective 
systems, the underlying representations, and even the basic system architecture. 
For example, in the letter series completion model of Simon and Kotovksy 
(1963), much attention is paid to the differential, short-term memory demands 
m'ade by different representations for different serial concepts, but tlie demands 
made during the induction of these concepts (ix., during their learning) are not 
directly addressed. Another example of this distinction can be found in Water- 
man's (1970) learning program in which the result of training was represented as 

^a production system, but the learning system itself was not a production system. 

Although such separation has the benefit of making the modeling task more 
manageable, it lacks both elegance and psychological plausibility. I would hazard . 
the guess that the same mechanisms that span the gap between general base 
strategy and the task-specific system (see jQuestion 3, above) are implicated in 
the learning process itself. The more homogeneously we design tlie MOLIM, the 
- more likely we aro to be able to solve both'-problems simultaneously. Such a 
view might be nothing more than idle speculation were it not for tlie recent 
work of my colleague, Don Waterman. He has constructed a set of adaptive 
production systems for a. range of learning tasks (Waterman, 1974a b). These 
models learn simple addition, verbal associations, and complex letter series, Each 
model is written as in initial core of productions, some of which have the 
capacity to add additional productions to the initial core. The final "learned" 
system 'operates under tlie same control structure and system architecture as the 
initial system and the learning rules are represented in precisely the same way as 
tlie new rules that are learned, that is, as productions. 

The instructional' JSnvironments in which Waterman's system do their self- 
modification are relatively simple, but I believe that the basic approach is very 
sound, and extendable to richer instructional problems. In a less precise but 
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.much mare general statement, \^'allace and I (Klfihr & Wallace, 1976) have 
proposed a broad view of cognitive development in ems of a self-modifying,, 
production system. ' 

f ^ ' ^ 

I 

CONCLUSION » 

.The chapters in this volume represent diverse but converging answers to the 
question of the relevance of some current research in cognitive psychology to 
ins'tructional desigii. I have not attempted to synthesize, evaluate, or review the 
previous chapters because several efforts have already, been made in the discus-^ 
sion chapters by Gregg, Olson, Farnham-Diggory, Hayes, Collins, Shaw, Glaser, 
and Cazden. Instead, my intent has been to provide an orientation that might 
help the reader to form his own evaluation of the research reported here. 

By confining attention to learning in intentionaJly instructional situations, I 
'have attempted to reduce the task to manageable proportions, IriStead of I 
concocting a general learning system, .1 have considered the design of more ' 
limited models of the effects of specific ^instructional situations.-Such models 
will initially tend to be largely deterrnltlfd by the task environment, that is, by 
the material and its forin oT presentatiori^Hpwever, there are some fundamental 
questions that are worth- asking, questions which may apply to. a wide range of 
instruction, even thgugl-i their answers may be task-specific. 

Having posed the design i:.sues, might ask ''a few questions about the 
enterprise, per se. Why bother with such-an effort? There seem to be a feW^^ood 
reasons. First, if we could actually build a sensible model, we could directly 
simulate the results of proposed instructional procedures. The potential value of | 
such instructional "pilot plants" is that they could replace the extensive field j 
testing of instructional variations that we are presently forced to use. But except I 
in the most simple situations, we are not yet able to build such models, and the I 
worth of the enterprise lies in its propaedeutic nature: it may give 'us an I 
introduction to the kinds of things we still need to know. Several of the I 
ccimments by other discussants in this volume have raised the disquieting. 1 
possibility that we may have little here that is really new or useful, I think that I 
such a view is unjustified, but the issue cannot really be addressed in the I 
abstract: jwe need concrete examples of what we are talking about. Thus, the I 
second reason for attempting to raise some design issues is that the. exercise of I 
constructing a model of learnmg from instruction wjll- provide us with, such I 
concrete examples. • n 

Another general question that we can ask dbout the^design of a MOLIM is | 
"Who cares?" Who might benefit from such an exercise? It seems to me to be I 
premature to claim that either instructors or learners (at least as traditionally I 
conceived) could benefit much fiom thinking about the design of learning I 
models. The payoff, at present, appears to be for the people who fall into the I 
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intersection of the categories of instructional designer and cognitive psychol- 
ogists. The contributors to this volume were ^elected because of just such a 
blend of interests and skills. Their answers to some of the questions I have raised 
are implicit in the work they'have presented in previous chapters. Perhaps other 
"learning engineers" can, in reaching tlieif own answers, b'^gin to apply and 
direct the. kinds of basic research tliat are. required to furthei our knowledge of 
both cognition and instruc don. 
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